[ 522.033768] env[65355]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.033768] env[65355]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.020025] env[65443]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.020025] env[65443]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.591268] env[65443]: INFO neutron.common.config [-] Logging enabled! [ 524.591610] env[65443]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev74 [ 524.591791] env[65443]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65443) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 524.592133] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 524.592233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 524.593113] env[65443]: WARNING oslo_policy.policy [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.593377] env[65443]: WARNING oslo_policy.policy [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 524.594992] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] VMware NSXv3 Agent initialized successfully. [ 524.595357] env[65443]: DEBUG oslo_concurrency.lockutils [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Acquiring lock "singleton_lock" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.595485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Acquired lock "singleton_lock" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.595685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Releasing lock "singleton_lock" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.595967] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Full set of CONF: {{(pid=65443) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 524.596090] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ******************************************************************************** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 524.596192] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Configuration options gathered from: {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 524.596537] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 524.596705] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 524.596828] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ================================================================================ {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 524.597018] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] agent_down_time = 75 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597157] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] allow_automatic_dhcp_failover = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597290] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] allow_bulk = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597430] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] api_extensions_path = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597567] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] api_paste_config = api-paste.ini {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597704] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] auth_strategy = keystone {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597808] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] backdoor_port = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.597906] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] backdoor_socket = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598049] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] backlog = 4096 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598184] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598337] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] bind_host = 0.0.0.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598473] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] bind_port = 9696 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598605] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] client_socket_timeout = 900 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598759] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] config_dir = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.598887] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599045] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] config_source = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599189] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] control_exchange = neutron {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599327] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] core_plugin = ml2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599463] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] debug = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599633] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] default_availability_zones = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599830] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.599972] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dhcp_agent_notification = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600117] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dhcp_agents_per_network = 1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600248] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dhcp_lease_duration = 86400 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600387] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dhcp_load_type = networks {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600574] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dns_domain = openstacklocal {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600735] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.600912] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_default_route_bfd = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601125] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_default_route_ecmp = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601273] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_dvr = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601408] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_new_agents = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601540] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601673] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_signals = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601805] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] enable_traditional_dhcp = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.601960] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] external_dns_driver = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602091] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] filter_validation = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602306] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] global_physnet_mtu = 8950 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602444] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] graceful_shutdown_timeout = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602625] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] host = cpu-1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602763] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] host_dvr_for_dhcp = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.602895] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] http_retries = 3 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603042] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] instance_format = [instance: %(uuid)s] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603179] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603313] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ipam_driver = internal {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603441] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ipv6_pd_enabled = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603571] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] l3_ha = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603706] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603838] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] l3_ha_network_physical_name = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.603974] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] l3_ha_network_type = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604126] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_color = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604254] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_config_append = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604388] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604514] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_dir = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604639] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_file = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604749] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_options = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.604923] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_rotate_interval = 1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605083] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_rotate_interval_type = days {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605223] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] log_rotation_type = none {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605369] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605493] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605641] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605781] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.605882] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606022] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_dns_nameservers = 5 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606156] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_header_line = 16384 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606284] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_l3_agents_per_router = 3 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606410] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_logfile_count = 30 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606536] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_logfile_size_mb = 200 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606661] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] max_subnet_host_routes = 20 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606796] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] my_ip = 10.180.1.21 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.606929] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] my_ipv6 = ::1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607066] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] network_auto_schedule = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607191] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] network_link_prefix = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607323] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607457] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] notify_nova_on_port_data_changes = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607591] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] notify_nova_on_port_status_changes = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607726] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] pagination_max_limit = -1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607852] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] publish_errors = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.607978] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rate_limit_burst = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608123] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rate_limit_except_level = CRITICAL {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608251] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rate_limit_interval = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608379] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] retry_until_window = 30 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608504] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] router_distributed = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608632] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rpc_resources_processing_step = 20 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608760] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rpc_response_max_timeout = 600 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.608886] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] rpc_response_timeout = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609026] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] send_events_interval = 2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609165] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] service_plugins = ['router'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609299] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] setproctitle = on {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609424] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] shell_completion = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609555] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] state_path = /opt/stack/data/neutron {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609712] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] syslog_log_facility = LOG_USER {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609845] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] tcp_keepidle = 600 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.609978] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] transport_url = **** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610120] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] use_journal = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610246] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] use_json = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610370] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] use_ssl = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610493] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] use_stderr = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610668] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] use_syslog = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610818] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vlan_qinq = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.610948] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vlan_transparent = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611088] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] watch_log_file = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611217] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] wsgi_default_pool_size = 100 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611342] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] wsgi_keep_alive = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611475] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611603] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] wsgi_server_debug = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 524.611751] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_concurrency.disable_process_locking = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.611892] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612041] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612173] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612307] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612442] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612573] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612727] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.connection_string = messaging:// {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612861] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.enabled = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.612996] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.es_doc_type = notification {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613138] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.es_scroll_size = 10000 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613272] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.es_scroll_time = 2m {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613407] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.filter_error_trace = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613542] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.hmac_keys = **** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613676] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.sentinel_service_name = mymaster {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613816] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.socket_timeout = 0.1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.613945] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.trace_requests = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614082] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler.trace_sqlalchemy = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614231] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler_jaeger.process_tags = {} {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614357] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler_jaeger.service_name_prefix = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614486] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] profiler_otlp.service_name_prefix = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614662] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.enforce_new_defaults = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.614906] env[65443]: WARNING oslo_config.cfg [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 524.615069] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.enforce_scope = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615214] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.policy_default_rule = default {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615365] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615501] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615637] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615770] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.615899] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616042] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616175] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616314] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616462] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616613] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] agent.extensions = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616751] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.616923] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] service_providers.service_provider = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617099] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.default_quota = -1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617247] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617379] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_floatingip = 50 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617522] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_network = 100 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617644] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_port = 500 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617779] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.617905] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_router = 10 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618044] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_security_group = 10 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618175] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618304] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.quota_subnet = 100 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618433] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] QUOTAS.track_quota_usage = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618580] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618709] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618838] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.618966] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619111] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619241] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619366] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619504] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619664] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619799] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.619929] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620073] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620209] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620339] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_dhcp_release.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620478] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620629] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620787] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.620924] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621073] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621212] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621339] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_ovs_vsctl.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621477] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.capabilities = [21] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621602] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621732] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.621869] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622051] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622227] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622362] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_namespace.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622502] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.capabilities = [12] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622630] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622790] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.622938] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623102] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623242] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623369] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_conntrack.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623508] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.capabilities = [12, 21] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623636] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.group = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623763] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.helper_command = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.623893] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.log_daemon_traceback = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624057] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624215] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.thread_pool_size = 8 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624346] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] privsep_link.user = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624502] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624649] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624789] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.continue_on_failed_promotions = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.624921] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.dscp = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625088] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.dscp_inherit = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625251] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.force_mp_to_policy = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625388] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.locking_coordinator_url = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625523] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.log_agent_heartbeats = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625654] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.logging_expire = 1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625793] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.625925] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626081] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.polling_interval = 240 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626252] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626401] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626547] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.report_interval = 30.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626693] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626836] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.626975] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.627174] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.sync_skew = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.627395] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.synchronization_queue_size = 20 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628014] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT.use_helper_for_ns_read = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628014] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] SECURITYGROUP.enable_ipset = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628014] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] SECURITYGROUP.enable_security_group = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628014] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628231] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628348] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] experimental.ipv6_pd_enabled = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628461] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.extension_drivers = ['port_security'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628596] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.external_network_type = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628749] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.628892] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.overlay_ip_version = 4 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629040] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.path_mtu = 8950 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629188] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.physical_network_mtus = {} {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629337] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629484] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629647] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ml2.type_drivers = ['vlan'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629804] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.629939] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630085] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630228] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630369] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630505] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630642] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630804] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.630947] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631162] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631311] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_login_password = **** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631457] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631595] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_login_user = admin {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631739] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.631878] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.632063] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.632256] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.632444] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.632637] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.632846] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.633050] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.633240] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.633433] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.633628] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.633830] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634049] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634351] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634550] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634703] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634845] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.634987] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.auth_section = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635144] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.auth_type = password {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635286] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635417] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.certfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635553] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.collect_timing = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635695] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.endpoint_type = public {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635830] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.insecure = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.635960] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.keyfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636112] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.region_name = RegionOne {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636247] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.split_loggers = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636373] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] nova.timeout = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636508] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.auth_section = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636657] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.auth_type = password {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636790] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.636920] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.certfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637067] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.collect_timing = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637208] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.endpoint_type = public {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637339] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.insecure = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637467] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.keyfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637620] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.region_name = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637758] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.split_loggers = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.637888] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] placement.timeout = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638037] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.auth_section = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638174] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.auth_type = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638304] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.cafile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638436] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.certfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638570] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.collect_timing = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638701] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.connect_retries = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638835] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.connect_retry_delay = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.638966] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.enable_notifications = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639104] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.endpoint_override = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639237] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.insecure = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639367] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.interface = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639496] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.keyfile = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639658] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.max_version = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639799] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.min_version = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.639930] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.region_name = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640075] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.retriable_status_codes = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640205] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.service_name = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640333] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.service_type = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640465] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.split_loggers = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640627] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.status_code_retries = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640767] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.status_code_retry_delay = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.640894] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.timeout = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641045] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.valid_interfaces = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641132] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ironic.version = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641270] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] cli_script.dry_run = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641412] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641549] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641671] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641804] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.641935] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642073] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642204] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642334] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642461] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642599] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642731] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.642869] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643016] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643157] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643289] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643426] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643558] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643690] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643829] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.643956] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644098] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644229] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644359] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644486] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644614] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644747] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.644876] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645024] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645144] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645275] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645404] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645544] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645680] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645811] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.645945] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646090] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646219] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646355] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_notifications.driver = [] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646485] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_notifications.retry = -1 {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646631] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646763] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 524.646865] env[65443]: DEBUG oslo_service.backend._eventlet.service [None req-45e33b55-7d4c-4d79-bad5-f0ef98bd10f6 None None] ******************************************************************************** {{(pid=65443) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 524.648022] env[65443]: DEBUG neutron.agent.securitygroups_rpc [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Init firewall settings (driver=nsxv3) {{(pid=65443) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 524.649350] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65443) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 524.649621] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] RPC agent_id: nsxm-l-01a.corp.local [ 524.651919] env[65443]: DEBUG dogpile.cache.region [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.652029] env[65443]: DEBUG dogpile.lock [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 524.652134] env[65443]: DEBUG dogpile.lock [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 524.652226] env[65443]: DEBUG dogpile.lock [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 524.652321] env[65443]: DEBUG dogpile.cache.region [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 524.652407] env[65443]: DEBUG dogpile.lock [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 524.652529] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 524.682378] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Session token - acquiring [ 524.683918] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.684155] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.684258] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.684661] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.696105] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.973430] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.993883] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.994060] env[65443]: DEBUG dogpile.cache.region [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.994126] env[65443]: DEBUG dogpile.lock [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.994216] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Activating Policy API Provider. [ 524.994449] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Looking for the default Infrastructure Rules. [ 525.069809] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Looking for the Default Layer3 Logged Drop Section. [ 525.086204] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 525.086663] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 525.086836] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 525.086940] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 525.087251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 525.087608] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.602386] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.104919] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 526.607479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Inventory metadata is going to be refreshed. [ 526.607874] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 527.392544] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.394020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.394020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.394020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.406379] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 527.407531] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.408378] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 527.430127] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.432017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.432017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.432017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.432017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.432017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 527.432017] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.432017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 527.455941] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.456499] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.456725] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.457114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.457402] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.457670] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 527.481677] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.482159] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.484016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.484016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.484016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.484016] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 527.503854] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.504391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.504603] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.504974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.505276] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.505595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 527.505822] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.506047] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 527.525484] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.526051] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.526312] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.526721] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.528018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.528018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 527.528018] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.528018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 527.549518] env[65443]: DEBUG networking_nsxv3.common.locking [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.550154] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.550398] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.550873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.551141] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.551403] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 527.551613] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 527.555017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Inventory metadata have been refreshed. [ 527.555017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Dryrun:True. Metadata refresh completed. [ 527.555017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Releasing lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.555017] env[65443]: INFO neutron.agent.agent_extensions_manager [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Loaded agent extensions: [] [ 527.555017] env[65443]: DEBUG neutron_lib.callbacks.manager [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65443) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 527.603918] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent RPC Daemon Started! [ 527.604354] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:0 started [ 527.604630] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent out of sync with plugin! [ 532.555791] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.555791] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.557085] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.557085] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.558473] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.558827] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.618800] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0a91c1db-c29b-46a5-84f9-0232c0e65668 demo admin] Enqueued Resource ID: de234c18-8123-4ef5-987c-93093e8f8380 with Priority: HIGHEST for action security_group_rules [ 542.619298] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de234c18-8123-4ef5-987c-93093e8f8380 with Priority: HIGHEST for action security_group_rules [ 542.619608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de234c18-8123-4ef5-987c-93093e8f8380 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.619742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de234c18-8123-4ef5-987c-93093e8f8380" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.619812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de234c18-8123-4ef5-987c-93093e8f8380" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.620223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de234c18-8123-4ef5-987c-93093e8f8380" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.620308] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de234c18-8123-4ef5-987c-93093e8f8380',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 543.140042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.140297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.140297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.140528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.140528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.140713] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de234c18-8123-4ef5-987c-93093e8f8380 already deleted. [ 543.140713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de234c18-8123-4ef5-987c-93093e8f8380" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.620381] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.620753] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.557816] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.558273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.558273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.558273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.558461] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.060889] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.563704] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.621211] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 552.621408] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 553.066213] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 553.066468] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 553.794072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.794547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.794547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.794547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.805124] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 553.805933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.806749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 553.824739] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.824937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.824937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.825151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.825235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.825347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 553.825419] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 553.825489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 553.847781] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.847984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.847984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.848236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.848500] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 553.868741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.868939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.868939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.869145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.869248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.869349] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 553.887459] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.887711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.887711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.887835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.887949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.888125] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 553.888125] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 553.888280] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 553.906821] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.907043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.907043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.907214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.907301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.907406] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 553.907477] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 553.907547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 553.926966] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.927218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.927218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.927357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.927459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.927571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 553.927643] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 553.927709] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 553.927768] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 553.927842] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 553.927906] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 553.927960] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 553.928267] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 553.928345] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 553.928396] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 553.948427] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.948642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.948642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.948808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.948911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.949028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 553.970573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.970787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.970787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.970956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.971109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.983688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.622455] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 557.622455] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.622961] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 562.623352] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.867831] env[65443]: INFO networking_nsxv3.common.synchronization [None req-bbbcbc62-e02d-4dc7-b9e4-b202e2895990 None None] Enqueued Resource ID: 41477038-c8f4-4940-9ceb-6d1dbd686abf with Priority: HIGHEST for action port [ 566.870195] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41477038-c8f4-4940-9ceb-6d1dbd686abf with Priority: HIGHEST for action port [ 566.870923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-41477038-c8f4-4940-9ceb-6d1dbd686abf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.871009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41477038-c8f4-4940-9ceb-6d1dbd686abf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.871139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41477038-c8f4-4940-9ceb-6d1dbd686abf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.871396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41477038-c8f4-4940-9ceb-6d1dbd686abf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.871497] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41477038-c8f4-4940-9ceb-6d1dbd686abf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.119133] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ff94d88d-62e5-47ab-a7db-805acc6b29e9 None None] Enqueued Resource ID: 0f9c37cb-8460-4a59-95fe-9c4814bacc59 with Priority: HIGHEST for action port [ 567.119382] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f9c37cb-8460-4a59-95fe-9c4814bacc59 with Priority: HIGHEST for action port [ 567.119934] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f9c37cb-8460-4a59-95fe-9c4814bacc59 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.120067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f9c37cb-8460-4a59-95fe-9c4814bacc59" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.120133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f9c37cb-8460-4a59-95fe-9c4814bacc59" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.120398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f9c37cb-8460-4a59-95fe-9c4814bacc59" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.120478] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f9c37cb-8460-4a59-95fe-9c4814bacc59',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.375950] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41477038-c8f4-4940-9ceb-6d1dbd686abf [ 567.376261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.376458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.376572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.376828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.376968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.377121] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41477038-c8f4-4940-9ceb-6d1dbd686abf already deleted. [ 567.377265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41477038-c8f4-4940-9ceb-6d1dbd686abf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.625445] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f9c37cb-8460-4a59-95fe-9c4814bacc59 [ 567.625673] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.625819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.625891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.626113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.626190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.626327] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f9c37cb-8460-4a59-95fe-9c4814bacc59 already deleted. [ 567.626385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f9c37cb-8460-4a59-95fe-9c4814bacc59" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.615941] env[65443]: INFO networking_nsxv3.common.synchronization [None req-84c0695b-ebb5-458e-86bb-50134224df13 None None] Enqueued Resource ID: 2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b with Priority: HIGHEST for action port [ 568.616320] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b with Priority: HIGHEST for action port [ 568.616829] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.616954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.617204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.617439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.617522] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.720383] env[65443]: INFO networking_nsxv3.common.synchronization [None req-afa21979-25c1-4e67-bdb0-f0f8f9cc509a None None] Enqueued Resource ID: 6a0d5fa4-f803-48e6-94d8-9e4364174123 with Priority: HIGHEST for action port [ 568.720980] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a0d5fa4-f803-48e6-94d8-9e4364174123 with Priority: HIGHEST for action port [ 568.721294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a0d5fa4-f803-48e6-94d8-9e4364174123 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.721466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a0d5fa4-f803-48e6-94d8-9e4364174123" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.721530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a0d5fa4-f803-48e6-94d8-9e4364174123" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.721738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a0d5fa4-f803-48e6-94d8-9e4364174123" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.722157] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a0d5fa4-f803-48e6-94d8-9e4364174123',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.120754] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b [ 569.121312] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.121493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.121565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.121775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.121859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.121952] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b already deleted. [ 569.122050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ed8f1fb-8ad5-4847-9609-8f8a8c753a2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.224501] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a0d5fa4-f803-48e6-94d8-9e4364174123 [ 569.224754] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.225074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.225074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.225184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.225277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.225403] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a0d5fa4-f803-48e6-94d8-9e4364174123 already deleted. [ 569.225513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a0d5fa4-f803-48e6-94d8-9e4364174123" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.512538] env[65443]: INFO networking_nsxv3.common.synchronization [None req-8cb3dd5e-a6ef-4182-8d2b-fc501ee1ac35 None None] Enqueued Resource ID: f85c2162-0f17-44e4-ad21-bdffad67dd1d with Priority: HIGHEST for action port [ 571.513072] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85c2162-0f17-44e4-ad21-bdffad67dd1d with Priority: HIGHEST for action port [ 571.513666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f85c2162-0f17-44e4-ad21-bdffad67dd1d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.513666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f85c2162-0f17-44e4-ad21-bdffad67dd1d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.513666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f85c2162-0f17-44e4-ad21-bdffad67dd1d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.513945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f85c2162-0f17-44e4-ad21-bdffad67dd1d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.514070] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f85c2162-0f17-44e4-ad21-bdffad67dd1d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.016444] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f85c2162-0f17-44e4-ad21-bdffad67dd1d [ 572.016689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.016826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.016896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.017107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.017197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.017292] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f85c2162-0f17-44e4-ad21-bdffad67dd1d already deleted. [ 572.017374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f85c2162-0f17-44e4-ad21-bdffad67dd1d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.932594] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ca0e7641-e8f0-4b4b-8596-f4d670b0293a None None] Enqueued Resource ID: 8f1c2894-7bde-49c6-8807-028311a14265 with Priority: HIGHEST for action port [ 573.933044] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f1c2894-7bde-49c6-8807-028311a14265 with Priority: HIGHEST for action port [ 573.933353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f1c2894-7bde-49c6-8807-028311a14265 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.933489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f1c2894-7bde-49c6-8807-028311a14265" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.933555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f1c2894-7bde-49c6-8807-028311a14265" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.933803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f1c2894-7bde-49c6-8807-028311a14265" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.933923] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f1c2894-7bde-49c6-8807-028311a14265',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.438130] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f1c2894-7bde-49c6-8807-028311a14265 [ 574.439725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.439925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.439991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.440259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.440371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.440485] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f1c2894-7bde-49c6-8807-028311a14265 already deleted. [ 574.440577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f1c2894-7bde-49c6-8807-028311a14265" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.952480] env[65443]: INFO networking_nsxv3.common.synchronization [None req-44b83bc2-4b57-4435-bafe-31e9ce8c84ef None None] Enqueued Resource ID: edba9c0d-a2b5-4133-826b-3cc14285d50d with Priority: HIGHEST for action port [ 574.952946] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edba9c0d-a2b5-4133-826b-3cc14285d50d with Priority: HIGHEST for action port [ 574.957728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-edba9c0d-a2b5-4133-826b-3cc14285d50d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.957728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-edba9c0d-a2b5-4133-826b-3cc14285d50d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.957728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-edba9c0d-a2b5-4133-826b-3cc14285d50d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.957728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-edba9c0d-a2b5-4133-826b-3cc14285d50d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.957728] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('edba9c0d-a2b5-4133-826b-3cc14285d50d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.249021] env[65443]: INFO networking_nsxv3.common.synchronization [None req-25743ab8-90c9-44b5-9921-38381b7ee7fb None None] Enqueued Resource ID: 7e64c401-4beb-4092-868e-5776f131d9ab with Priority: HIGHEST for action port [ 575.249021] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e64c401-4beb-4092-868e-5776f131d9ab with Priority: HIGHEST for action port [ 575.249021] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e64c401-4beb-4092-868e-5776f131d9ab taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.249021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e64c401-4beb-4092-868e-5776f131d9ab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.249021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e64c401-4beb-4092-868e-5776f131d9ab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.249021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e64c401-4beb-4092-868e-5776f131d9ab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.249021] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e64c401-4beb-4092-868e-5776f131d9ab',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.458994] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port edba9c0d-a2b5-4133-826b-3cc14285d50d [ 575.462161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.462161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.462161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.462161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.462161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.462161] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:edba9c0d-a2b5-4133-826b-3cc14285d50d already deleted. [ 575.462161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-edba9c0d-a2b5-4133-826b-3cc14285d50d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.730041] env[65443]: INFO networking_nsxv3.common.synchronization [None req-44a74eea-3048-4cd5-b06b-4aea199faba7 None None] Enqueued Resource ID: 89ca7648-9e50-4a53-8306-8c472d076288 with Priority: HIGHEST for action port [ 575.730652] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89ca7648-9e50-4a53-8306-8c472d076288 with Priority: HIGHEST for action port [ 575.731215] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-89ca7648-9e50-4a53-8306-8c472d076288 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.731215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89ca7648-9e50-4a53-8306-8c472d076288" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.731215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89ca7648-9e50-4a53-8306-8c472d076288" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.731452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89ca7648-9e50-4a53-8306-8c472d076288" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.731515] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89ca7648-9e50-4a53-8306-8c472d076288',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.751481] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e64c401-4beb-4092-868e-5776f131d9ab [ 575.751744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.751857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.751926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.752246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.752246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.752340] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e64c401-4beb-4092-868e-5776f131d9ab already deleted. [ 575.752400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e64c401-4beb-4092-868e-5776f131d9ab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.237279] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89ca7648-9e50-4a53-8306-8c472d076288 [ 576.237589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.237724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.237724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.237918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.238016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.238111] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89ca7648-9e50-4a53-8306-8c472d076288 already deleted. [ 576.238191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89ca7648-9e50-4a53-8306-8c472d076288" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.971184] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ee549092-ae2c-43fe-94e4-8eb3a644ea60 None None] Enqueued Resource ID: 9d1ab364-240a-470b-8a2b-eb3357cf172a with Priority: HIGHEST for action port [ 576.971474] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d1ab364-240a-470b-8a2b-eb3357cf172a with Priority: HIGHEST for action port [ 576.971800] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d1ab364-240a-470b-8a2b-eb3357cf172a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.971927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d1ab364-240a-470b-8a2b-eb3357cf172a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.972061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d1ab364-240a-470b-8a2b-eb3357cf172a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.973028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d1ab364-240a-470b-8a2b-eb3357cf172a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.973028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d1ab364-240a-470b-8a2b-eb3357cf172a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.306946] env[65443]: INFO networking_nsxv3.common.synchronization [None req-fcda7d5b-d456-4f82-88f1-077cf08b2311 None None] Enqueued Resource ID: e3e7ab36-f481-424b-ab6a-6f7167ab78e6 with Priority: HIGHEST for action port [ 577.306946] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3e7ab36-f481-424b-ab6a-6f7167ab78e6 with Priority: HIGHEST for action port [ 577.306946] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3e7ab36-f481-424b-ab6a-6f7167ab78e6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.307313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3e7ab36-f481-424b-ab6a-6f7167ab78e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.307586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3e7ab36-f481-424b-ab6a-6f7167ab78e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.308017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3e7ab36-f481-424b-ab6a-6f7167ab78e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.308176] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3e7ab36-f481-424b-ab6a-6f7167ab78e6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.476033] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d1ab364-240a-470b-8a2b-eb3357cf172a [ 577.477016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.477016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.477016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.477016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.477016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.477016] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d1ab364-240a-470b-8a2b-eb3357cf172a already deleted. [ 577.477016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d1ab364-240a-470b-8a2b-eb3357cf172a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.812829] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e3e7ab36-f481-424b-ab6a-6f7167ab78e6 [ 577.812829] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.812829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.812829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.812829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.812829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.812829] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e3e7ab36-f481-424b-ab6a-6f7167ab78e6 already deleted. [ 577.812829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3e7ab36-f481-424b-ab6a-6f7167ab78e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.821288] env[65443]: INFO networking_nsxv3.common.synchronization [None req-32af3193-0bc9-4934-afac-dc1e7a80f58d None None] Enqueued Resource ID: 8995e999-a5f8-4b78-9d5a-8ea9a559f487 with Priority: HIGHEST for action port [ 577.821288] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8995e999-a5f8-4b78-9d5a-8ea9a559f487 with Priority: HIGHEST for action port [ 577.821288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8995e999-a5f8-4b78-9d5a-8ea9a559f487 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.821288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8995e999-a5f8-4b78-9d5a-8ea9a559f487" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.822511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8995e999-a5f8-4b78-9d5a-8ea9a559f487" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.823148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8995e999-a5f8-4b78-9d5a-8ea9a559f487" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.823403] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8995e999-a5f8-4b78-9d5a-8ea9a559f487',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.326726] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8995e999-a5f8-4b78-9d5a-8ea9a559f487 [ 578.327024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.327206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.327331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.327596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.327698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.327943] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8995e999-a5f8-4b78-9d5a-8ea9a559f487 already deleted. [ 578.327943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8995e999-a5f8-4b78-9d5a-8ea9a559f487" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.158182] env[65443]: INFO networking_nsxv3.common.synchronization [None req-72478f70-d3fd-4c32-9572-a1b6f76ce95d None None] Enqueued Resource ID: 4a72559e-83a3-4ae1-8a47-613d1d3dd9bb with Priority: HIGHEST for action port [ 580.158182] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a72559e-83a3-4ae1-8a47-613d1d3dd9bb with Priority: HIGHEST for action port [ 580.160218] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a72559e-83a3-4ae1-8a47-613d1d3dd9bb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.160539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a72559e-83a3-4ae1-8a47-613d1d3dd9bb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.160979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a72559e-83a3-4ae1-8a47-613d1d3dd9bb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.162234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a72559e-83a3-4ae1-8a47-613d1d3dd9bb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.164066] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a72559e-83a3-4ae1-8a47-613d1d3dd9bb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.494420] env[65443]: INFO networking_nsxv3.common.synchronization [None req-9ae48eb7-46dc-4d8b-a9c2-a66abe69c69b None None] Enqueued Resource ID: 90fc6b4f-1ecb-49e2-b8f7-f4a297815878 with Priority: HIGHEST for action port [ 580.494960] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fc6b4f-1ecb-49e2-b8f7-f4a297815878 with Priority: HIGHEST for action port [ 580.495283] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-90fc6b4f-1ecb-49e2-b8f7-f4a297815878 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.495415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90fc6b4f-1ecb-49e2-b8f7-f4a297815878" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.495503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90fc6b4f-1ecb-49e2-b8f7-f4a297815878" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.495735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90fc6b4f-1ecb-49e2-b8f7-f4a297815878" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.495820] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90fc6b4f-1ecb-49e2-b8f7-f4a297815878',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.665568] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a72559e-83a3-4ae1-8a47-613d1d3dd9bb [ 580.667098] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.667098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.667098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.667098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.667098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.667098] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a72559e-83a3-4ae1-8a47-613d1d3dd9bb already deleted. [ 580.667098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a72559e-83a3-4ae1-8a47-613d1d3dd9bb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.001116] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90fc6b4f-1ecb-49e2-b8f7-f4a297815878 [ 581.001116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.001116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.001116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.001116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.001602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.001602] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90fc6b4f-1ecb-49e2-b8f7-f4a297815878 already deleted. [ 581.001602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90fc6b4f-1ecb-49e2-b8f7-f4a297815878" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.034645] env[65443]: INFO networking_nsxv3.common.synchronization [None req-31d077d5-133d-458c-adf2-30e3d9a51fdb None None] Enqueued Resource ID: 0c4678df-7d14-4eb5-96a2-45f586cd4434 with Priority: HIGHEST for action port [ 581.034910] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4678df-7d14-4eb5-96a2-45f586cd4434 with Priority: HIGHEST for action port [ 581.035516] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c4678df-7d14-4eb5-96a2-45f586cd4434 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.035598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c4678df-7d14-4eb5-96a2-45f586cd4434" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.035640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c4678df-7d14-4eb5-96a2-45f586cd4434" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.035882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c4678df-7d14-4eb5-96a2-45f586cd4434" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.035994] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c4678df-7d14-4eb5-96a2-45f586cd4434',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.538227] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c4678df-7d14-4eb5-96a2-45f586cd4434 [ 581.538581] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.538651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.538742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.538970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.539121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.539220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c4678df-7d14-4eb5-96a2-45f586cd4434 already deleted. [ 581.539303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c4678df-7d14-4eb5-96a2-45f586cd4434" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.094802] env[65443]: INFO networking_nsxv3.common.synchronization [None req-8822adaf-b717-46c9-9dbe-e2de91f9d44a None None] Enqueued Resource ID: 0907690e-0c6c-4b9a-be81-9a96f03ac94b with Priority: HIGHEST for action port [ 582.094889] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0907690e-0c6c-4b9a-be81-9a96f03ac94b with Priority: HIGHEST for action port [ 582.095473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0907690e-0c6c-4b9a-be81-9a96f03ac94b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.095609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0907690e-0c6c-4b9a-be81-9a96f03ac94b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.095730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0907690e-0c6c-4b9a-be81-9a96f03ac94b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.095942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0907690e-0c6c-4b9a-be81-9a96f03ac94b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.096197] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0907690e-0c6c-4b9a-be81-9a96f03ac94b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.598735] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0907690e-0c6c-4b9a-be81-9a96f03ac94b [ 582.599089] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.599519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.599667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.600070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.600210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.600336] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0907690e-0c6c-4b9a-be81-9a96f03ac94b already deleted. [ 582.600471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0907690e-0c6c-4b9a-be81-9a96f03ac94b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.934727] env[65443]: INFO networking_nsxv3.common.synchronization [None req-135d9640-3b8d-4a43-a803-f6332c256c7f None None] Enqueued Resource ID: 249d899a-4642-4286-ac22-7b46bf6ee68e with Priority: HIGHEST for action port [ 582.934727] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249d899a-4642-4286-ac22-7b46bf6ee68e with Priority: HIGHEST for action port [ 582.934727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-249d899a-4642-4286-ac22-7b46bf6ee68e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.934727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249d899a-4642-4286-ac22-7b46bf6ee68e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.934727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249d899a-4642-4286-ac22-7b46bf6ee68e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.934984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249d899a-4642-4286-ac22-7b46bf6ee68e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.934984] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249d899a-4642-4286-ac22-7b46bf6ee68e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.438419] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 249d899a-4642-4286-ac22-7b46bf6ee68e [ 583.438562] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.438712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.438804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.439544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.439544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.439544] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:249d899a-4642-4286-ac22-7b46bf6ee68e already deleted. [ 583.439544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249d899a-4642-4286-ac22-7b46bf6ee68e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.586692] env[65443]: INFO networking_nsxv3.common.synchronization [req-4bc17972-6ed8-46f0-94f1-ac0b7fa0124a req-9bbc31db-b938-4201-b378-ff9b5491af04 tempest-TenantUsagesTestJSON-1937329192 tempest-TenantUsagesTestJSON-1937329192-project-member] Enqueued Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 583.587289] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 583.587616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.587751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.587820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.588496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.588496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.588633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.588682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.588859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.588967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.589148] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.718279] env[65443]: INFO networking_nsxv3.common.synchronization [None req-45c9d1ff-a8ed-4651-a9d5-99004535b3e8 None None] Enqueued Resource ID: 72625fe9-2c46-4acf-88b6-a44b7fc7ad4c with Priority: HIGHEST for action port [ 583.719365] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72625fe9-2c46-4acf-88b6-a44b7fc7ad4c with Priority: HIGHEST for action port [ 583.719510] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-72625fe9-2c46-4acf-88b6-a44b7fc7ad4c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.720081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72625fe9-2c46-4acf-88b6-a44b7fc7ad4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.720402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72625fe9-2c46-4acf-88b6-a44b7fc7ad4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.721074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72625fe9-2c46-4acf-88b6-a44b7fc7ad4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.721380] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72625fe9-2c46-4acf-88b6-a44b7fc7ad4c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.851206] env[65443]: INFO networking_nsxv3.common.synchronization [None req-eef6961b-3baf-4383-a34c-70bf9a387c7c None None] Enqueued Resource ID: 7379adb4-c1ee-4892-8147-3809f7ab56e4 with Priority: HIGHEST for action port [ 583.852070] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7379adb4-c1ee-4892-8147-3809f7ab56e4 with Priority: HIGHEST for action port [ 583.852383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7379adb4-c1ee-4892-8147-3809f7ab56e4 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.852514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7379adb4-c1ee-4892-8147-3809f7ab56e4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.852594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7379adb4-c1ee-4892-8147-3809f7ab56e4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.852835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7379adb4-c1ee-4892-8147-3809f7ab56e4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.852917] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7379adb4-c1ee-4892-8147-3809f7ab56e4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.091702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.091867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.091925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.092259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.092259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.092432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.092529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.092585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.092802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.092802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.092931] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 already deleted. [ 584.092962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.225126] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72625fe9-2c46-4acf-88b6-a44b7fc7ad4c [ 584.225366] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.225498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.225565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.225800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.225858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.225950] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72625fe9-2c46-4acf-88b6-a44b7fc7ad4c already deleted. [ 584.226064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72625fe9-2c46-4acf-88b6-a44b7fc7ad4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.354829] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7379adb4-c1ee-4892-8147-3809f7ab56e4 [ 584.355601] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.355601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.355601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.355601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.355850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.356105] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7379adb4-c1ee-4892-8147-3809f7ab56e4 already deleted. [ 584.356234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7379adb4-c1ee-4892-8147-3809f7ab56e4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.203255] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.203561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.203616] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.203893] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.204160] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.204314] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.204423] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.204651] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.204795] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.205109] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.205216] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.205318] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.205422] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.205524] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.205624] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.205748] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.227780] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.227881] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.227950] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.228139] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.228444] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a7e8262d-be2d-4374-a0c8-29b78573255e taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.228612] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.228744] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.229098] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.229283] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7e8262d-be2d-4374-a0c8-29b78573255e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.481793] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c6e5715c-2520-4db5-97d7-3c1540ff2336 None None] Enqueued Resource ID: c37823e6-41c7-477a-82ad-f7ba410c89ea with Priority: HIGHEST for action port [ 585.483545] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c37823e6-41c7-477a-82ad-f7ba410c89ea with Priority: HIGHEST for action port [ 585.483545] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c37823e6-41c7-477a-82ad-f7ba410c89ea taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.483545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c37823e6-41c7-477a-82ad-f7ba410c89ea" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.483545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c37823e6-41c7-477a-82ad-f7ba410c89ea" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.483545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c37823e6-41c7-477a-82ad-f7ba410c89ea" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.483813] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c37823e6-41c7-477a-82ad-f7ba410c89ea',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.736566] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.736904] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.736962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.737628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.737981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.738425] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a7e8262d-be2d-4374-a0c8-29b78573255e not found, creating... [ 585.739673] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.739673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.739673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.739673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.739673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.739928] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.740104] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.740232] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.740617] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.740792] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.741287] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a7e8262d-be2d-4374-a0c8-29b78573255e is going to be created. [ 585.764891] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.764891] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.764891] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.764891] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.765226] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.765226] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.791794] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ed0a6a59-948f-4297-8b1b-6532e1507db8 None None] Enqueued Resource ID: 3a27beb8-9347-41ef-9480-ad30a56f9a33 with Priority: HIGHEST for action port [ 585.792050] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a27beb8-9347-41ef-9480-ad30a56f9a33 with Priority: HIGHEST for action port [ 585.792376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a27beb8-9347-41ef-9480-ad30a56f9a33 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.792518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a27beb8-9347-41ef-9480-ad30a56f9a33" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.792619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a27beb8-9347-41ef-9480-ad30a56f9a33" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.792846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a27beb8-9347-41ef-9480-ad30a56f9a33" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.792940] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a27beb8-9347-41ef-9480-ad30a56f9a33',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.986081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c37823e6-41c7-477a-82ad-f7ba410c89ea [ 585.986361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.986539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.986617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.986831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.986928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.987078] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c37823e6-41c7-477a-82ad-f7ba410c89ea already deleted. [ 585.987177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c37823e6-41c7-477a-82ad-f7ba410c89ea" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.296895] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a27beb8-9347-41ef-9480-ad30a56f9a33 [ 586.297187] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.297187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.297187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.297404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.297495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.297592] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a27beb8-9347-41ef-9480-ad30a56f9a33 already deleted. [ 586.297674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a27beb8-9347-41ef-9480-ad30a56f9a33" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.526166] env[65443]: INFO networking_nsxv3.common.synchronization [req-4bc17972-6ed8-46f0-94f1-ac0b7fa0124a req-8107f13c-179e-45bf-b0a1-fccc28b48cf7 service nova] Enqueued Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_rules [ 586.529386] env[65443]: INFO networking_nsxv3.common.synchronization [req-4bc17972-6ed8-46f0-94f1-ac0b7fa0124a req-8107f13c-179e-45bf-b0a1-fccc28b48cf7 service nova] Enqueued Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 586.529665] env[65443]: INFO networking_nsxv3.common.synchronization [req-4bc17972-6ed8-46f0-94f1-ac0b7fa0124a req-8107f13c-179e-45bf-b0a1-fccc28b48cf7 service nova] Enqueued Resource ID: a7e8262d-be2d-4374-a0c8-29b78573255e with Priority: HIGHEST for action port [ 586.530371] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_rules [ 586.530520] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 586.530752] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7e8262d-be2d-4374-a0c8-29b78573255e with Priority: HIGHEST for action port [ 586.531062] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.531198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.531269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.531738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.531738] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.532755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.533670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.533670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.533670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.533670] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.533670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.533670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.533917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.533947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.534262] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.536288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7e8262d-be2d-4374-a0c8-29b78573255e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.536288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.536288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.536288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.537268] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7e8262d-be2d-4374-a0c8-29b78573255e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.726151] env[65443]: INFO networking_nsxv3.common.synchronization [None req-25a91094-2b2e-4fb7-989e-5524d9418fde tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 586.726151] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 586.726339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.726387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.726422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.727010] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.727010] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.004312] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a040078a-e890-435d-9c3c-06de4ed82c6f tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 587.004914] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 587.005233] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.007058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.038845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.039033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.045616] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a7e8262d-be2d-4374-a0c8-29b78573255e with status ACTIVE [ 587.045616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.045616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.048213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.048383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.048528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.048808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.048926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.048999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.049171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.049254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.049442] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.049543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.049619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.049762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.049837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.049922] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a7e8262d-be2d-4374-a0c8-29b78573255e is going to be updated. [ 587.052425] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.087993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.087993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.087993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.087993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.087993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.087993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7e8262d-be2d-4374-a0c8-29b78573255e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.256624] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.256624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.256624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.256624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.256624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.256949] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7ca5770-a687-4792-9de6-c002c902a32a already deleted. [ 587.256949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.256949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.257170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.257228] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.488997] env[65443]: INFO networking_nsxv3.common.synchronization [req-c32a046a-4868-454e-8c4b-cd7388c67a8c req-7167f434-d1f2-422a-834e-56504d7dcd08 tempest-DeleteServersAdminTestJSON-386804794 tempest-DeleteServersAdminTestJSON-386804794-project-member] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 587.489677] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 587.490707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.490707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.490707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.492309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.492309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.492309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.492309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.492309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.492309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.493036] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.556756] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.784382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.784382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.784382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.784570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.784601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.785448] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7ca5770-a687-4792-9de6-c002c902a32a already deleted. [ 587.785448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.995959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.996182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.996266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.996468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.996567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.996749] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.996848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.996985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.997127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.997197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.997823] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb already deleted. [ 587.997823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.059603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.060107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.060237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.060636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.060791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.060902] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 is going to be created. [ 588.093388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.093592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.093592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.093828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.093979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.104973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: UNINITIALIZED for 2s [ 588.669550] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.669922] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.669922] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.671462] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.671803] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.672110] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.672269] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.672526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.672716] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.673220] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.673220] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.673220] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.673361] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.673398] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 588.673763] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.673763] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.693366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.693503] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 588.693644] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.693786] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.694105] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-6762706e-b7be-4052-8305-48c037b26b72 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.696030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.696030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.696030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.696030] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6762706e-b7be-4052-8305-48c037b26b72',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.750936] env[65443]: INFO networking_nsxv3.common.synchronization [None req-61509796-a811-455e-983f-b8e80c4e6569 tempest-ServersTestBootFromVolume-1705188138 tempest-ServersTestBootFromVolume-1705188138-project-member] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 588.752214] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 588.753736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.753831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.753864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.754481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.754591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.007065] env[65443]: INFO networking_nsxv3.common.synchronization [None req-6d237d90-1dca-40aa-a8ad-c2f7042680ad None None] Enqueued Resource ID: f4b436a3-983a-420f-baaa-5fb47e5a3981 with Priority: HIGHEST for action port [ 589.007276] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4b436a3-983a-420f-baaa-5fb47e5a3981 with Priority: HIGHEST for action port [ 589.008457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4b436a3-983a-420f-baaa-5fb47e5a3981 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.008648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4b436a3-983a-420f-baaa-5fb47e5a3981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.008721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4b436a3-983a-420f-baaa-5fb47e5a3981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.009035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4b436a3-983a-420f-baaa-5fb47e5a3981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.009111] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4b436a3-983a-420f-baaa-5fb47e5a3981',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.010860] env[65443]: INFO networking_nsxv3.common.synchronization [None req-79c79cf6-d935-4461-8fc1-1df06c81f751 None None] Enqueued Resource ID: 56631071-e8ce-4253-801a-3207cc814fae with Priority: HIGHEST for action port [ 589.011423] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56631071-e8ce-4253-801a-3207cc814fae with Priority: HIGHEST for action port [ 589.011807] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-56631071-e8ce-4253-801a-3207cc814fae taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.011906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56631071-e8ce-4253-801a-3207cc814fae" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.011942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56631071-e8ce-4253-801a-3207cc814fae" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.012639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56631071-e8ce-4253-801a-3207cc814fae" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.012639] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56631071-e8ce-4253-801a-3207cc814fae',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.110346] env[65443]: INFO networking_nsxv3.common.synchronization [None req-93bc574e-2d08-4d03-9979-5a41c35a3a09 tempest-ServersTestBootFromVolume-1705188138 tempest-ServersTestBootFromVolume-1705188138-project-member] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 589.112352] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 589.112352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.112352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.199406] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.201385] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 6762706e-b7be-4052-8305-48c037b26b72 not found, creating... [ 589.201385] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.201385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.201654] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.201722] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.201985] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.202150] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.202271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.202835] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.202835] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.204033] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 6762706e-b7be-4052-8305-48c037b26b72 is going to be created. [ 589.249377] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.249650] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.249786] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.250063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.250291] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.250528] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.274688] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.274853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.274918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.275154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.275314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.275356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c113e23-4653-415c-8339-d252037cc64b already deleted. [ 589.275409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.275549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.275694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.275779] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.512911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4b436a3-983a-420f-baaa-5fb47e5a3981 [ 589.512911] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.512911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.512911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.512911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.512911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.512911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4b436a3-983a-420f-baaa-5fb47e5a3981 already deleted. [ 589.512911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4b436a3-983a-420f-baaa-5fb47e5a3981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.514649] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56631071-e8ce-4253-801a-3207cc814fae [ 589.514860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.514983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.515059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.515234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.515309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.515394] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56631071-e8ce-4253-801a-3207cc814fae already deleted. [ 589.515469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56631071-e8ce-4253-801a-3207cc814fae" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.796828] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.797114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.797114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.797301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.798049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.798049] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c113e23-4653-415c-8339-d252037cc64b already deleted. [ 589.798049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.989703] env[65443]: INFO networking_nsxv3.common.synchronization [req-c32a046a-4868-454e-8c4b-cd7388c67a8c req-aa630fe4-2fc3-45c2-9f4e-4ca4090c6db9 service nova] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_rules [ 589.989870] env[65443]: INFO networking_nsxv3.common.synchronization [req-c32a046a-4868-454e-8c4b-cd7388c67a8c req-aa630fe4-2fc3-45c2-9f4e-4ca4090c6db9 service nova] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 589.989995] env[65443]: INFO networking_nsxv3.common.synchronization [req-c32a046a-4868-454e-8c4b-cd7388c67a8c req-aa630fe4-2fc3-45c2-9f4e-4ca4090c6db9 service nova] Enqueued Resource ID: 6762706e-b7be-4052-8305-48c037b26b72 with Priority: HIGHEST for action port [ 589.990707] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_rules [ 589.990752] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 589.990834] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6762706e-b7be-4052-8305-48c037b26b72 with Priority: HIGHEST for action port [ 589.991110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.991324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.991324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.991601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.991688] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.992867] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.992867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.992996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.993093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.993286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.993353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.993391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.993600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.993704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.993778] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.994589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6762706e-b7be-4052-8305-48c037b26b72 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.995076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.995550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.995550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.995550] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6762706e-b7be-4052-8305-48c037b26b72',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.116069] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: SUCCESS [ 590.116795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.116795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.117305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.117499] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.117677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.117786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.117992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.118296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.118296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.118402] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.366373] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfe0688e-255b-4b3f-a7b4-27baeff883ce req-086e7d2b-1a3d-4761-9340-24a3cdb913ac tempest-ServersAdminNegativeTestJSON-1088238682 tempest-ServersAdminNegativeTestJSON-1088238682-project-member] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 590.367265] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 590.367265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.367505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.367569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.367820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.368022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.368116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.368154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.368296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.368400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.368454] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.497172] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.498470] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.498470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.498683] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6762706e-b7be-4052-8305-48c037b26b72 with status ACTIVE [ 590.498683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.498885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.498885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.499206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.499206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.499505] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.499505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.499505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.499651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.499651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.500691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.500691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.500691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.501175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.501299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.501402] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6762706e-b7be-4052-8305-48c037b26b72 is going to be updated. [ 590.530413] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.530413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.530413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.530413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.530413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.530413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6762706e-b7be-4052-8305-48c037b26b72" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.622608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.625939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.625939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.625939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.625939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.626708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.626708] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.870242] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.870726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.870726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.870726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.870831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.870992] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.871413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.871413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.871413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.871413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.871606] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 already deleted. [ 590.871606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.005179] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.094034] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.094184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.094184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.094446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.094699] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.094850] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.094957] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.095832] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.095993] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.096222] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.096335] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 591.096452] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 591.096625] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 591.096742] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 591.096842] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 591.096974] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 591.117150] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 591.117379] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 591.117578] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 591.117852] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.119032] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-47aae831-5b43-4058-a177-3e3eed7944a8 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.119032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.119032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.119677] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.119908] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47aae831-5b43-4058-a177-3e3eed7944a8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.133017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5fc7c7e4-ccff-4f6f-b071-841331d702a0: rpc.has_security_group_logging(os_id): False [ 591.152150] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.152336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.152416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.152732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.152851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.153118] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.153224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.153288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.153583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.153583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.153751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.153857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.153920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.154237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.154361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.154565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.154707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.154787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.155060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.155186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.155298] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 is going to be created. [ 591.223658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.223856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.223920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.225079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.225079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.237797] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: IN_PROGRESS for 2s [ 591.409321] env[65443]: INFO networking_nsxv3.common.synchronization [None req-916441e0-53dc-4107-aafc-20f37e86a005 None None] Enqueued Resource ID: b557a314-f3f4-4c9b-aa85-8f89fb98316c with Priority: HIGHEST for action port [ 591.410401] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b557a314-f3f4-4c9b-aa85-8f89fb98316c with Priority: HIGHEST for action port [ 591.410708] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b557a314-f3f4-4c9b-aa85-8f89fb98316c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.410917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b557a314-f3f4-4c9b-aa85-8f89fb98316c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.411038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b557a314-f3f4-4c9b-aa85-8f89fb98316c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.411373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b557a314-f3f4-4c9b-aa85-8f89fb98316c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.411550] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b557a314-f3f4-4c9b-aa85-8f89fb98316c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.507717] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.507898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.507898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.508075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.508174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.508269] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be created. [ 591.541045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.541045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.541045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.541045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.541045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.550983] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: UNINITIALIZED for 2s [ 591.626025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.626025] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 47aae831-5b43-4058-a177-3e3eed7944a8 not found, creating... [ 591.626025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.626025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.626586] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.626586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.626586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.626586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.626586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.626586] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 47aae831-5b43-4058-a177-3e3eed7944a8 is going to be created. [ 591.650408] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.650748] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.650821] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.651104] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.651333] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.651559] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.915661] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b557a314-f3f4-4c9b-aa85-8f89fb98316c [ 591.915942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.916062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.916150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.916351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.916443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.916539] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b557a314-f3f4-4c9b-aa85-8f89fb98316c already deleted. [ 591.916619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b557a314-f3f4-4c9b-aa85-8f89fb98316c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.140794] env[65443]: INFO networking_nsxv3.common.synchronization [None req-73684a60-64bf-4bd5-9b56-d2506297ce81 tempest-VolumesAssistedSnapshotsTest-83228541 tempest-VolumesAssistedSnapshotsTest-83228541-project-member] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 592.141204] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 592.141517] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.141693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.141783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.142017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.142276] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.353402] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfe0688e-255b-4b3f-a7b4-27baeff883ce req-a4714cd3-ea62-4595-a5d7-646a8185bb51 service nova] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_rules [ 592.353939] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfe0688e-255b-4b3f-a7b4-27baeff883ce req-a4714cd3-ea62-4595-a5d7-646a8185bb51 service nova] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 592.353939] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfe0688e-255b-4b3f-a7b4-27baeff883ce req-a4714cd3-ea62-4595-a5d7-646a8185bb51 service nova] Enqueued Resource ID: 47aae831-5b43-4058-a177-3e3eed7944a8 with Priority: HIGHEST for action port [ 592.355581] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_rules [ 592.355581] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 592.355581] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47aae831-5b43-4058-a177-3e3eed7944a8 with Priority: HIGHEST for action port [ 592.360999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.360999] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.360999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.360999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.360999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.361515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.361515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.361583] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.362471] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-47aae831-5b43-4058-a177-3e3eed7944a8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.362595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.362691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.362856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.362963] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47aae831-5b43-4058-a177-3e3eed7944a8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.666048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.666048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.666048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.666048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.666048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.666048] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 already deleted. [ 592.667644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.748266] env[65443]: INFO networking_nsxv3.common.synchronization [req-69b2a735-7e01-40f4-a4c6-81531c1151bc req-b022ea57-973b-425f-9d15-f690b6f2e708 tempest-ServerExternalEventsTest-1810177272 tempest-ServerExternalEventsTest-1810177272-project-member] Enqueued Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 592.748893] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 592.749596] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.749596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.749596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.749957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.749957] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.749957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.750099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.750194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.750280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.750374] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.865709] env[65443]: INFO networking_nsxv3.common.synchronization [None req-740837eb-7c51-4c76-9726-b53f878dd0c3 tempest-VolumesAssistedSnapshotsTest-83228541 tempest-VolumesAssistedSnapshotsTest-83228541-project-member] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 592.865709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.865709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.865709] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 592.865709] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.866211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 47aae831-5b43-4058-a177-3e3eed7944a8 with status ACTIVE [ 592.866737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.866737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.866737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.867474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.867474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.867474] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.867700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.867700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.867700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.867786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.867930] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.868146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.868146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.868545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.868545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.868545] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 47aae831-5b43-4058-a177-3e3eed7944a8 is going to be updated. [ 592.870982] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.870982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.870982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.870982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.870982] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.902036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.902036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.902036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.902036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.902036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.902036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47aae831-5b43-4058-a177-3e3eed7944a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.238893] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.239239] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.239239] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.239494] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.240367] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.240603] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.240775] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.241366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.241366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.241366] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.241670] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 593.241739] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 593.241894] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 593.242065] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 593.242177] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 593.242344] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 593.252655] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.252808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.252897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.253119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.253208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.253403] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.253497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.253558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.253701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.253776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.253858] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf already deleted. [ 593.253937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.260911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: SUCCESS [ 593.261161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.264139] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 593.264431] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 593.264600] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 593.264702] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.265012] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.265210] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.265346] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.265600] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.265733] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('897ddb0d-97bb-4f75-b59e-1ebab1eea5d3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.373888] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.392598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.392794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.392844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.393045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.393139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.393234] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 already deleted. [ 593.393314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.467146] env[65443]: INFO networking_nsxv3.common.synchronization [None req-9d175f04-2185-49c4-90e9-6a877e065f0c None None] Enqueued Resource ID: 8ea8baa5-a96e-4c63-bda2-2e7b98a12828 with Priority: HIGHEST for action port [ 593.467146] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ea8baa5-a96e-4c63-bda2-2e7b98a12828 with Priority: HIGHEST for action port [ 593.467146] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ea8baa5-a96e-4c63-bda2-2e7b98a12828 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.467146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ea8baa5-a96e-4c63-bda2-2e7b98a12828" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.467146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ea8baa5-a96e-4c63-bda2-2e7b98a12828" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.467146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ea8baa5-a96e-4c63-bda2-2e7b98a12828" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.467146] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ea8baa5-a96e-4c63-bda2-2e7b98a12828',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.561708] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 593.561915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.562097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.562384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.562523] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.562640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.562704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.562858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.562937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.563065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.563132] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.768613] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.768864] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.768986] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.769268] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.769413] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.769560] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 not found, creating... [ 593.769813] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.769958] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.770080] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.770281] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.770408] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.770719] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.770860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.770972] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.771185] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.771309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.771441] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 is going to be created. [ 593.790444] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.790715] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.792430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.792430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.792430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.792430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.876721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.876884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.876955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.877205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.877300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.877400] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be created. [ 593.917832] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.917982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.918068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.918294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.918892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.929819] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: UNINITIALIZED for 2s [ 593.970039] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ea8baa5-a96e-4c63-bda2-2e7b98a12828 [ 593.970039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.970039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.970039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.970039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.970765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.971552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ea8baa5-a96e-4c63-bda2-2e7b98a12828 already deleted. [ 593.971552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ea8baa5-a96e-4c63-bda2-2e7b98a12828" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.065950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.066192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.066192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.066413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.066588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.066759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.066880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.067164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.069046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.069046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.069046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.069617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.069617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.069617] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.571733] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fe6210d-3498-4e0f-b810-00e0478f00cb: rpc.has_security_group_logging(os_id): False [ 594.592020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.592020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.592020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.592020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.592663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.593121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.597035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.597035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.597035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.597035] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be created. [ 594.604029] env[65443]: INFO networking_nsxv3.common.synchronization [req-69b2a735-7e01-40f4-a4c6-81531c1151bc req-89495e19-34ff-4a27-a5cd-b607ef94cf84 service nova] Enqueued Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_rules [ 594.604269] env[65443]: INFO networking_nsxv3.common.synchronization [req-69b2a735-7e01-40f4-a4c6-81531c1151bc req-89495e19-34ff-4a27-a5cd-b607ef94cf84 service nova] Enqueued Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 594.604448] env[65443]: INFO networking_nsxv3.common.synchronization [req-69b2a735-7e01-40f4-a4c6-81531c1151bc req-89495e19-34ff-4a27-a5cd-b607ef94cf84 service nova] Enqueued Resource ID: 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 with Priority: HIGHEST for action port [ 594.604999] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_rules [ 594.605203] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 594.605350] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 with Priority: HIGHEST for action port [ 594.605668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.605899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.606257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.606376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.606376] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.607690] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.607788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.607889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.610039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.610039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.610039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.610039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.610039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.610039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.610039] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.611739] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.611739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.611739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.612417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.612509] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('897ddb0d-97bb-4f75-b59e-1ebab1eea5d3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.655871] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.659088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.659088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.659088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.659088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.669635] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 594.761785] env[65443]: INFO networking_nsxv3.common.synchronization [req-b704cb1b-5293-4930-91a9-1c3cd2e6a308 req-2913e4dd-8227-460a-aca7-a1640ab30943 tempest-FloatingIPsAssociationTestJSON-1022144113 tempest-FloatingIPsAssociationTestJSON-1022144113-project-member] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 594.763090] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 594.763484] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.763780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.763780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.764426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.764426] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.764567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.765306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.765903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.765903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.765903] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.114084] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.115451] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.115574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.115888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 with status ACTIVE [ 595.116121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.116240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.116289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.116528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.116603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.119024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.119024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.119024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.119024] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 897ddb0d-97bb-4f75-b59e-1ebab1eea5d3 is going to be updated. [ 595.142622] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.142622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.142622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.142622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.142622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.142622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-897ddb0d-97bb-4f75-b59e-1ebab1eea5d3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.145897] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.146133] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.146206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.146515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.146769] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.146921] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.147509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.147509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.147509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.147752] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.147867] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.147971] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.148084] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.148188] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.148287] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.148414] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.169908] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.170128] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.170270] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.170440] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.170782] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.170953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.171108] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.171382] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.171499] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563c0a80-9e7a-4f3f-9dd1-d6fee14bee79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.271583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.271583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.271583] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 already deleted. [ 595.271583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.617070] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.678961] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.678961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.678961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.678961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.678961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.678961] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 not found, creating... [ 595.678961] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.678961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.679295] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.679471] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.679536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.680271] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.681945] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.682336] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.684308] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.684440] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.684598] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 is going to be created. [ 595.706803] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.706947] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.707033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.707914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.708191] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.708601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.942028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.942028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.942028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.942028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.072914] env[65443]: INFO networking_nsxv3.common.synchronization [None req-188ec3b2-2892-4796-b0d0-e088449fd62a None None] Enqueued Resource ID: 0e721ec5-53c8-4ad4-ae12-2a678be944a5 with Priority: HIGHEST for action port [ 596.073804] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e721ec5-53c8-4ad4-ae12-2a678be944a5 with Priority: HIGHEST for action port [ 596.074068] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e721ec5-53c8-4ad4-ae12-2a678be944a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.074190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e721ec5-53c8-4ad4-ae12-2a678be944a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.074190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e721ec5-53c8-4ad4-ae12-2a678be944a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.074482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e721ec5-53c8-4ad4-ae12-2a678be944a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.074568] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e721ec5-53c8-4ad4-ae12-2a678be944a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.122285] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.122285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.122285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.123238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.123238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.123238] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf is going to be created. [ 596.157323] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.157536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.157752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.158084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.158306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.173310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: UNINITIALIZED for 2s [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [req-b704cb1b-5293-4930-91a9-1c3cd2e6a308 req-4ea87dc5-a379-4e8b-a73d-7133d263bef1 service nova] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_rules [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [req-b704cb1b-5293-4930-91a9-1c3cd2e6a308 req-4ea87dc5-a379-4e8b-a73d-7133d263bef1 service nova] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [req-b704cb1b-5293-4930-91a9-1c3cd2e6a308 req-4ea87dc5-a379-4e8b-a73d-7133d263bef1 service nova] Enqueued Resource ID: 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 with Priority: HIGHEST for action port [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_rules [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 596.403023] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 with Priority: HIGHEST for action port [ 596.403023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.403023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.403023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.403990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.404250] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.408399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.408519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.408585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.411029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.411029] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.411029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.411029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.411029] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('563c0a80-9e7a-4f3f-9dd1-d6fee14bee79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.445310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.447134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.447277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.447541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.447839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.447964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.448043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.448221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.448312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.448402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.448557] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.448650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.448712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.448876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.449031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.449141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.449201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.449340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.449416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.449498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.449585] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.576892] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e721ec5-53c8-4ad4-ae12-2a678be944a5 [ 596.577146] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.577286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.577353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.577575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.577656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.577742] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e721ec5-53c8-4ad4-ae12-2a678be944a5 already deleted. [ 596.577820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e721ec5-53c8-4ad4-ae12-2a678be944a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.682139] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 596.682139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.913122] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.913294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.913506] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.914587] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 with status ACTIVE [ 596.914796] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.914939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.915013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.915932] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.915932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.916345] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.916345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.916421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.916606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.916682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.916771] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 563c0a80-9e7a-4f3f-9dd1-d6fee14bee79 is going to be updated. [ 596.949611] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.949767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.949837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.950055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.950196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.950397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-563c0a80-9e7a-4f3f-9dd1-d6fee14bee79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.954126] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33573b4-6e20-4958-b534-744277031b44: rpc.has_security_group_logging(os_id): False [ 596.986835] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.986835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.986835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.986835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.986835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.987479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.987479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.987479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.987479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.987705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.988017] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.988017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.988156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.988349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.988505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.988954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.988954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.988954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.989234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.989293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.989525] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be created. [ 597.081758] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.081997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.081997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.082181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.082808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.098311] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 597.418823] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.921863] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.922237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.922237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.922440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.922529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.922610] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be created. [ 597.949443] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.949603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.949674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.949879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.950052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.966122] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: UNINITIALIZED for 2s [ 598.183286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: SUCCESS [ 598.183673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.183673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.184154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.184154] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.184287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.184322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.184472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.184551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.184636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.184727] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.686685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.687715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.687715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.687715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.687715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.687715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.687959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.687959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.688036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.688139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.688258] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.688349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.688409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.688545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.688691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.688783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.688842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.688962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.690242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.690242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.690242] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.117132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 599.117758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.194206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf: rpc.has_security_group_logging(os_id): False [ 599.216329] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.216500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.220023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.220023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.220023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.221060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.221060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.221321] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.221412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.221412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.221562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.221637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.221723] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf is going to be created. [ 599.309777] env[65443]: INFO networking_nsxv3.common.synchronization [req-2ed03384-3dc6-406d-82dd-565429702188 req-9204b391-2ca7-4b3a-8904-f85950aca224 tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 599.310994] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 599.310994] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.310994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.310994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.310994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.311866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.312439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.312439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.312439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.312651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.312651] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.362707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.362707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.362707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.362707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.363065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.379181] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: IN_PROGRESS for 2s [ 599.814717] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.814884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.814945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.815263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.815371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.815564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.815667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.815723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.815879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.815954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.816049] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec already deleted. [ 599.816128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.819513] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.819687] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.819804] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.820049] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.820293] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.820443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.820551] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.820901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.821020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.821666] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.821779] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.821888] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.821995] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.822113] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.822214] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.822370] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.842237] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.842472] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.842679] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.842976] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.843361] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-4aba2ff3-061b-465e-a731-ec54cf750b27 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.843615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.843814] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.844209] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.844413] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aba2ff3-061b-465e-a731-ec54cf750b27',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.977707] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 599.977935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.978185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.978428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.978704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.978974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.978974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.979219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.979347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.979454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.980096] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.346654] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.347272] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.347272] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.347372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.347512] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.347734] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 4aba2ff3-061b-465e-a731-ec54cf750b27 not found, creating... [ 600.348057] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.348208] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.348896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.348896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.348896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.349183] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349361] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.349529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.349648] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.349791] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 4aba2ff3-061b-465e-a731-ec54cf750b27 is going to be created. [ 600.373602] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.373835] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.373947] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.374264] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.374534] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.374903] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.482868] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.483256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.483256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.483592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.483780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.483914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.483971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.484156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.484317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.484317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.484471] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.484584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.484636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.484755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.484925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.485428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.485428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.485648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.485648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.485824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.485934] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.989207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e1792da-b313-46fc-bec2-ab5ddb70bee3: rpc.has_security_group_logging(os_id): False [ 601.010761] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.010983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.011123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.011298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.011389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.011596] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.011691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.011752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.011932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.011981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.012252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.012322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.012377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.012517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.012626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.012793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.012921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.012956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.013440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.013440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.013440] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be created. [ 601.088439] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.088669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.088756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.089028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.089320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.103762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 601.262261] env[65443]: INFO networking_nsxv3.common.synchronization [req-2ed03384-3dc6-406d-82dd-565429702188 req-e51c82f2-6da8-48f8-826f-675ae27f3497 service nova] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_rules [ 601.262261] env[65443]: INFO networking_nsxv3.common.synchronization [req-2ed03384-3dc6-406d-82dd-565429702188 req-e51c82f2-6da8-48f8-826f-675ae27f3497 service nova] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 601.262477] env[65443]: INFO networking_nsxv3.common.synchronization [req-2ed03384-3dc6-406d-82dd-565429702188 req-e51c82f2-6da8-48f8-826f-675ae27f3497 service nova] Enqueued Resource ID: 4aba2ff3-061b-465e-a731-ec54cf750b27 with Priority: HIGHEST for action port [ 601.262964] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_rules [ 601.263121] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 601.263442] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aba2ff3-061b-465e-a731-ec54cf750b27 with Priority: HIGHEST for action port [ 601.263633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.263633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.263742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.264118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.269262] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.271235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.271235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.271235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.271235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.271235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.271235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.271235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.271545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.271545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.271545] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.273946] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aba2ff3-061b-465e-a731-ec54cf750b27 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.273946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.273946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.275537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.275537] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aba2ff3-061b-465e-a731-ec54cf750b27',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.393168] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: SUCCESS [ 601.393430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.711979] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d27f5b1-f32a-480e-b53c-c6838a0460d0 req-7e86366c-c93d-49a7-bf0c-9bdaef74659f tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 601.711979] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 601.712388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.712528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.712626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.713000] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.713398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.713597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.715161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.715161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.715161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.715161] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.778182] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.779384] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.779568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.780940] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4aba2ff3-061b-465e-a731-ec54cf750b27 with status ACTIVE [ 601.780940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.780940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.780940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.780940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.780940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.781518] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.781518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.782079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.782079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.782079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.782360] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.782360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.782495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.782543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.782600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.782721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4aba2ff3-061b-465e-a731-ec54cf750b27 is going to be updated. [ 601.821725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.822023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.822023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.822205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.822274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.822960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aba2ff3-061b-465e-a731-ec54cf750b27" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.219609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.219816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.219864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.220210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.220327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.220572] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.220819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.220918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.221152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.221273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.221380] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7ca5770-a687-4792-9de6-c002c902a32a already deleted. [ 602.221557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.286142] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.356508] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.356508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.356508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.356508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.363134] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.363134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.363134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.363134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.363134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.363134] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.363134] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.363134] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.363134] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.363134] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.363134] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.363134] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.385288] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.385288] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.385475] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.388532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.388532] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-58b013a8-5508-4dd2-89fd-15a7e6e99539 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.388532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.388532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.388532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.388532] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b013a8-5508-4dd2-89fd-15a7e6e99539',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.792550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.792885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.792885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.793254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.793355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.793462] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be created. [ 602.821899] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.822166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.822166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.822348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.822509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.834381] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: UNINITIALIZED for 2s [ 602.892227] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.892498] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.892574] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.893328] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.893630] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.893812] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 58b013a8-5508-4dd2-89fd-15a7e6e99539 not found, creating... [ 602.894096] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.894259] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.894367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.894601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.894730] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.895086] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.895228] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.895366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.895475] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.895640] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.895726] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 58b013a8-5508-4dd2-89fd-15a7e6e99539 is going to be created. [ 602.917850] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.917960] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.918033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.918340] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.919484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.919484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.116932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 603.117145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.636046] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d27f5b1-f32a-480e-b53c-c6838a0460d0 req-6b391662-fc3c-42ed-8fb9-4420ec9f5cae service nova] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 603.636766] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d27f5b1-f32a-480e-b53c-c6838a0460d0 req-6b391662-fc3c-42ed-8fb9-4420ec9f5cae service nova] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 603.636766] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d27f5b1-f32a-480e-b53c-c6838a0460d0 req-6b391662-fc3c-42ed-8fb9-4420ec9f5cae service nova] Enqueued Resource ID: 58b013a8-5508-4dd2-89fd-15a7e6e99539 with Priority: HIGHEST for action port [ 603.636976] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_rules [ 603.637338] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 603.637338] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58b013a8-5508-4dd2-89fd-15a7e6e99539 with Priority: HIGHEST for action port [ 603.637633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.637633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.637633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.637824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.637932] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.639432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.640035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.640035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.640035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.640035] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.640198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.640198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.640256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.640653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.640653] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.643374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-58b013a8-5508-4dd2-89fd-15a7e6e99539 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.643374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.643374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.643374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.643374] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58b013a8-5508-4dd2-89fd-15a7e6e99539',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.086687] env[65443]: INFO networking_nsxv3.common.synchronization [req-5104d940-b96e-4a40-8b12-f82645fe3eeb req-8c46e4dc-e274-4d0c-a4d0-5afdda467e5f tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 604.087397] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 604.087788] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.088102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.088102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.088301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.088428] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.088533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.088612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.088769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.088914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.089013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.144360] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.146881] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.147084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.148050] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 58b013a8-5508-4dd2-89fd-15a7e6e99539 with status ACTIVE [ 604.148416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.148804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.148878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.149092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.149195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.149500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.149655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.150125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.150125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.150125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.150278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.150278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.150365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.150867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.151067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.152112] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 58b013a8-5508-4dd2-89fd-15a7e6e99539 is going to be updated. [ 604.180941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.181148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.181237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.181720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.181720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.181835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58b013a8-5508-4dd2-89fd-15a7e6e99539" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.592410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.594539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.594539] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa already deleted. [ 604.594539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.648785] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.820111] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.820389] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.820580] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.821046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.821413] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.821641] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.821811] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.822199] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.822345] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.822670] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.822797] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.822969] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.823157] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.823326] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.823495] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.823691] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.844510] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 604.844733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.844900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.845129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.845315] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.845450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.845508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.845682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.845764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.845849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.845942] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.852666] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.852852] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.852968] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.853196] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.853521] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a8e18aee-b11d-458c-945a-72d1ccfaba7e taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.853708] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.853820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.854143] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.854290] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e18aee-b11d-458c-945a-72d1ccfaba7e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.127936] env[65443]: INFO networking_nsxv3.common.synchronization [None req-cef8dc2b-2a50-4856-ad72-a0b7c8b6f8d3 None None] Enqueued Resource ID: 175c9d84-b9ab-4d1b-acad-d1cbc8029ec0 with Priority: HIGHEST for action port [ 605.128359] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 175c9d84-b9ab-4d1b-acad-d1cbc8029ec0 with Priority: HIGHEST for action port [ 605.128454] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-175c9d84-b9ab-4d1b-acad-d1cbc8029ec0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.128619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-175c9d84-b9ab-4d1b-acad-d1cbc8029ec0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.128619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-175c9d84-b9ab-4d1b-acad-d1cbc8029ec0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.129289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-175c9d84-b9ab-4d1b-acad-d1cbc8029ec0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.129422] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('175c9d84-b9ab-4d1b-acad-d1cbc8029ec0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.153216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.153458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.153584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.153866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.153973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.154495] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7ca5770-a687-4792-9de6-c002c902a32a is going to be created. [ 605.185650] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.185650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.185818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.186115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.186367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.198416] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: UNINITIALIZED for 2s [ 605.349624] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.349724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.349768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.349998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.350215] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.350358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.350426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.350569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.350664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.350798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.351093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.351093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.351224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.351270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.351383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.351468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.351525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.351654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.351888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.351991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.352192] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.356995] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.357313] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.357434] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.357691] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.357902] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.358040] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a8e18aee-b11d-458c-945a-72d1ccfaba7e not found, creating... [ 605.358295] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.358448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.358562] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.358894] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.358894] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.359213] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.359361] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.359473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.359663] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.359791] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.359924] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a8e18aee-b11d-458c-945a-72d1ccfaba7e is going to be created. [ 605.382814] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.383170] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.383170] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.383435] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.383659] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.383884] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.543537] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c8df62f9-9952-4d91-a1c9-f7a70fbb00c1 None None] Enqueued Resource ID: 5d2d08ca-8cba-43df-8aef-a522f2c33f45 with Priority: HIGHEST for action port [ 605.544134] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d2d08ca-8cba-43df-8aef-a522f2c33f45 with Priority: HIGHEST for action port [ 605.544395] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d2d08ca-8cba-43df-8aef-a522f2c33f45 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.544541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d2d08ca-8cba-43df-8aef-a522f2c33f45" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.544613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d2d08ca-8cba-43df-8aef-a522f2c33f45" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.545230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d2d08ca-8cba-43df-8aef-a522f2c33f45" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.545230] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d2d08ca-8cba-43df-8aef-a522f2c33f45',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.632739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 175c9d84-b9ab-4d1b-acad-d1cbc8029ec0 [ 605.633067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.633245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.633341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.633641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.633772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.633905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:175c9d84-b9ab-4d1b-acad-d1cbc8029ec0 already deleted. [ 605.634028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-175c9d84-b9ab-4d1b-acad-d1cbc8029ec0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.854142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81bf2cab-4b9a-41ce-82f6-260bedede9ec: rpc.has_security_group_logging(os_id): False [ 605.874509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.874710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.874710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.874983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.875092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.875297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.875398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.875457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.875609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.875686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.875861] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.875954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.876023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.876165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.876237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.876407] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.876496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.876555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.876691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.876765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.876847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be created. [ 605.949319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.949319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.949319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.949319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.949319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.962964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 606.047314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d2d08ca-8cba-43df-8aef-a522f2c33f45 [ 606.047558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.047675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.047731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.047949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.048059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.048157] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d2d08ca-8cba-43df-8aef-a522f2c33f45 already deleted. [ 606.048241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d2d08ca-8cba-43df-8aef-a522f2c33f45" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.104021] env[65443]: INFO networking_nsxv3.common.synchronization [req-5104d940-b96e-4a40-8b12-f82645fe3eeb req-67f8a1ce-4799-4f29-acab-46d6d4de121a service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 606.104205] env[65443]: INFO networking_nsxv3.common.synchronization [req-5104d940-b96e-4a40-8b12-f82645fe3eeb req-67f8a1ce-4799-4f29-acab-46d6d4de121a service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 606.105489] env[65443]: INFO networking_nsxv3.common.synchronization [req-5104d940-b96e-4a40-8b12-f82645fe3eeb req-67f8a1ce-4799-4f29-acab-46d6d4de121a service nova] Enqueued Resource ID: a8e18aee-b11d-458c-945a-72d1ccfaba7e with Priority: HIGHEST for action port [ 606.107232] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 606.107426] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 606.107603] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8e18aee-b11d-458c-945a-72d1ccfaba7e with Priority: HIGHEST for action port [ 606.107928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.108108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.108167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.109036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.109036] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.111174] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.111244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.111302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.111530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.112201] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.112325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.112392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.112683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.112683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.112807] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.114161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8e18aee-b11d-458c-945a-72d1ccfaba7e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.114404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.114404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114728] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8e18aee-b11d-458c-945a-72d1ccfaba7e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.614730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.614730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.617229] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8e18aee-b11d-458c-945a-72d1ccfaba7e with status ACTIVE [ 606.617446] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.617578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.617648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.617865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.617957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.618156] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.618253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.618316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.618474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.618561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.618917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.618917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.618917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.619076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.619108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.619198] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8e18aee-b11d-458c-945a-72d1ccfaba7e is going to be updated. [ 606.621605] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.646583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.646583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.646583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.647013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8e18aee-b11d-458c-945a-72d1ccfaba7e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.785686] env[65443]: INFO networking_nsxv3.common.synchronization [req-08fe8aac-8f1e-4f5e-8578-ff424736de6e req-c79b47e1-36d4-405e-a073-cbd5aa9c585b tempest-ServerDiagnosticsNegativeTest-649700980 tempest-ServerDiagnosticsNegativeTest-649700980-project-member] Enqueued Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 606.786019] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 606.788335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.788557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.788725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.789016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.789199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.789307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.789370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.789537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.789622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.789724] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.999332] env[65443]: INFO networking_nsxv3.common.synchronization [None req-93619df0-289d-47ae-b0eb-b3143b6d8015 None None] Enqueued Resource ID: 501fbec9-88c6-44ae-8903-d3f0c5f7cfaa with Priority: HIGHEST for action port [ 606.999608] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 501fbec9-88c6-44ae-8903-d3f0c5f7cfaa with Priority: HIGHEST for action port [ 607.000229] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-501fbec9-88c6-44ae-8903-d3f0c5f7cfaa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.000229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-501fbec9-88c6-44ae-8903-d3f0c5f7cfaa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.000229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-501fbec9-88c6-44ae-8903-d3f0c5f7cfaa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.000460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-501fbec9-88c6-44ae-8903-d3f0c5f7cfaa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.000570] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('501fbec9-88c6-44ae-8903-d3f0c5f7cfaa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.126136] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.204873] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.204873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.204873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.204873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.204873] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.205271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.205427] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.205742] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.206073] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.206330] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.206529] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.206727] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.206924] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.207284] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.207510] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.207679] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.216959] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: SUCCESS [ 607.216959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.217663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.217663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.218373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.218507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.218851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.218851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.218851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.219039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.219039] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.234410] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.234661] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.234811] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.235256] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.236047] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-4f663dbc-b199-49a1-a329-767f56d246d2 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.236047] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.236047] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.236047] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.236259] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f663dbc-b199-49a1-a329-767f56d246d2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.292986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.293088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.293873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.293873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.293873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.293873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.293873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.293873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.294094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.294094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.294159] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad already deleted. [ 607.297728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.503664] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 501fbec9-88c6-44ae-8903-d3f0c5f7cfaa [ 607.503891] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.504046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.504115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.504408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.504408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.504512] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:501fbec9-88c6-44ae-8903-d3f0c5f7cfaa already deleted. [ 607.504588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-501fbec9-88c6-44ae-8903-d3f0c5f7cfaa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.623401] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a0681e12-3202-4c2e-afd7-4f49fb1b2cb9 None None] Enqueued Resource ID: 12631611-f1e0-492c-8eac-1bc467e02622 with Priority: HIGHEST for action port [ 607.623699] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12631611-f1e0-492c-8eac-1bc467e02622 with Priority: HIGHEST for action port [ 607.623930] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-12631611-f1e0-492c-8eac-1bc467e02622 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.624712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12631611-f1e0-492c-8eac-1bc467e02622" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.624712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12631611-f1e0-492c-8eac-1bc467e02622" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.624910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12631611-f1e0-492c-8eac-1bc467e02622" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.626120] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12631611-f1e0-492c-8eac-1bc467e02622',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.632219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.632219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.632219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.632219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.632219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.632219] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be created. [ 607.665819] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.666106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.666106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.666312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.666439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.678053] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: UNINITIALIZED for 2s [ 607.721263] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.738474] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.738716] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.738839] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.739158] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.739319] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.739486] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 4f663dbc-b199-49a1-a329-767f56d246d2 not found, creating... [ 607.739818] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.740066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.740391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.740538] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.740684] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.741033] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.741418] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.741507] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.742134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.742394] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.742477] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 4f663dbc-b199-49a1-a329-767f56d246d2 is going to be created. [ 607.770030] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.770030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.770030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.770030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.770030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.770030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.977560] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 607.977560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.127748] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12631611-f1e0-492c-8eac-1bc467e02622 [ 608.127748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.127914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.127914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.128159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.128288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.128401] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12631611-f1e0-492c-8eac-1bc467e02622 already deleted. [ 608.128526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12631611-f1e0-492c-8eac-1bc467e02622" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.225891] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7ca5770-a687-4792-9de6-c002c902a32a: rpc.has_security_group_logging(os_id): False [ 608.255056] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.255414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.255621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.255961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.256095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.256377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.256533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.256564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.256719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.256802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.256888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7ca5770-a687-4792-9de6-c002c902a32a is going to be created. [ 608.366736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.366904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.366975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.367216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.367395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.380433] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: IN_PROGRESS for 2s [ 608.518220] env[65443]: INFO networking_nsxv3.common.synchronization [req-08fe8aac-8f1e-4f5e-8578-ff424736de6e req-3d534cd3-a2f6-438d-9a85-2323c937ea85 service nova] Enqueued Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_rules [ 608.518314] env[65443]: INFO networking_nsxv3.common.synchronization [req-08fe8aac-8f1e-4f5e-8578-ff424736de6e req-3d534cd3-a2f6-438d-9a85-2323c937ea85 service nova] Enqueued Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 608.518434] env[65443]: INFO networking_nsxv3.common.synchronization [req-08fe8aac-8f1e-4f5e-8578-ff424736de6e req-3d534cd3-a2f6-438d-9a85-2323c937ea85 service nova] Enqueued Resource ID: 4f663dbc-b199-49a1-a329-767f56d246d2 with Priority: HIGHEST for action port [ 608.519115] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_rules [ 608.519266] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 608.519920] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f663dbc-b199-49a1-a329-767f56d246d2 with Priority: HIGHEST for action port [ 608.519920] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.519920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.519920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.520263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.520362] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.521268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.521375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.521415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.521563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.521705] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.521880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.521880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.522369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.522369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.522369] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.522908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f663dbc-b199-49a1-a329-767f56d246d2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.523017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.523085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.523231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.523299] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f663dbc-b199-49a1-a329-767f56d246d2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.575992] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1b65ff1-7e94-47db-95a1-fa7db52fa4cf req-d1ccea20-7a24-4681-b614-1f9c4ad2b3c8 tempest-VolumesAssistedSnapshotsTest-83228541 tempest-VolumesAssistedSnapshotsTest-83228541-project-member] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 608.576587] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 608.577033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.577033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.577229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.577390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.577821] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.577821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.577821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.577821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.578102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.578102] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.028028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.028028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.028028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.028028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f663dbc-b199-49a1-a329-767f56d246d2 with status ACTIVE [ 609.028028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.028028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.028028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.028028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.028028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.030193] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.030932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.031501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.032175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.032175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.033873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.033873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.033873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.033873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.033873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.033873] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f663dbc-b199-49a1-a329-767f56d246d2 is going to be updated. [ 609.062393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.062620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.062620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.062805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.062939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.063196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f663dbc-b199-49a1-a329-767f56d246d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.079836] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.079973] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-900" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.080061] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-900" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.080477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-900" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.080969] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.080969] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.081696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.081696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.081696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.081696] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.081839] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.081993] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.082158] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.082338] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.082503] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.082699] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.084865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.085135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.085247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.085489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.085622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.085934] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.086404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.086404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.086404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.086498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.086627] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 already deleted. [ 609.086777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.107285] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.107406] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.107643] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.107957] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-900" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.108529] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-e0a90c57-fee7-4180-86a2-37a189191d1c taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.108761] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.108887] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.109272] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.109405] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0a90c57-fee7-4180-86a2-37a189191d1c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.536603] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.615271] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.615271] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port e0a90c57-fee7-4180-86a2-37a189191d1c not found, creating... [ 609.615271] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.615271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.615705] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.620225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.620225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.620225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.620225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.620225] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: e0a90c57-fee7-4180-86a2-37a189191d1c is going to be created. [ 609.646881] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.647132] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.647238] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.647579] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.647741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.647966] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.690815] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 609.691164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.691477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692918] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.040171] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.040690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.040690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.040827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.040863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.042561] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad is going to be created. [ 610.090164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.090413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.090464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.090675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.090996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.103700] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: UNINITIALIZED for 2s [ 610.195041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.195784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.195959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.196290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.196612] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.196854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.197102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.197499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.199033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.199033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.199033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.199674] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.393146] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: SUCCESS [ 610.393511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.406093] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1b65ff1-7e94-47db-95a1-fa7db52fa4cf req-2b84c0f9-abd8-4478-ba09-bf7294efba43 service nova] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 610.406273] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1b65ff1-7e94-47db-95a1-fa7db52fa4cf req-2b84c0f9-abd8-4478-ba09-bf7294efba43 service nova] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 610.406405] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1b65ff1-7e94-47db-95a1-fa7db52fa4cf req-2b84c0f9-abd8-4478-ba09-bf7294efba43 service nova] Enqueued Resource ID: e0a90c57-fee7-4180-86a2-37a189191d1c with Priority: HIGHEST for action port [ 610.406900] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_rules [ 610.407035] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 610.407135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0a90c57-fee7-4180-86a2-37a189191d1c with Priority: HIGHEST for action port [ 610.407398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.407541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.407625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.407764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.407841] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.409451] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.409622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.409782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.410071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.410274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.410451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.410546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.410748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.410938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.411089] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.411941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0a90c57-fee7-4180-86a2-37a189191d1c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.414556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.414637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.414795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.414888] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0a90c57-fee7-4180-86a2-37a189191d1c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.664077] env[65443]: INFO networking_nsxv3.common.synchronization [req-852c345c-af95-4c91-be9d-f08fcf9ef9cf req-8c8b1879-0f6b-4cbd-8371-ea547df5ea6a tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 610.664077] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 610.664499] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.664776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.664965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.665309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.665638] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.667524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.667524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.667524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.667524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.667524] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.701332] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 373eadf5-9140-4fc8-8636-38b8598454fa: rpc.has_security_group_logging(os_id): False [ 610.719032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.719713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.719713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.719713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.719980] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.720088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.721099] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.721099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.721404] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.721404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.721404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.721566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.721655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.721767] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be created. [ 610.790072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.790226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.790297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.790501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.790734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.804218] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 610.833648] env[65443]: INFO networking_nsxv3.common.synchronization [None req-711300ec-7076-4bb2-8123-935674782f86 tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 610.834391] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 610.834795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.835167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.835270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.836985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.836985] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.917128] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.918154] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.918275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.918683] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0a90c57-fee7-4180-86a2-37a189191d1c with status ACTIVE [ 610.918855] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.918983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.919077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.919358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.919460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.919635] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.919732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.919794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.919951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.922611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.922916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.923645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.923775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.924028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.924992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.925185] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0a90c57-fee7-4180-86a2-37a189191d1c is going to be updated. [ 610.950145] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.950145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.950145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.950145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.950145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.950145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0a90c57-fee7-4180-86a2-37a189191d1c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.951316] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c863ab91-eea8-41d9-b998-8d046aee8050 tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 610.952035] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 610.952134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.952243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.165736] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.166601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.166601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.166601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.166761] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.167473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.167473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.167473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.167473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.168162] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.168162] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.168162] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.168162] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.170019] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.170019] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.170019] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.170238] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.204036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.204036] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.204036] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.204036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.204036] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.204036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.204036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.205281] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.205549] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97369f77-4dfb-4cf4-9ab3-0550b1b5b204',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.363421] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.363421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.363613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.363856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.364025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.364131] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e already deleted. [ 611.364263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.364558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.364784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.364976] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.419363] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.674153] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.709171] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.709273] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.709370] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.709632] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.709774] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.709923] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 not found, creating... [ 611.710595] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.710895] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.711532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.711532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.711532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.711710] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.712161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.712161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.712161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.712307] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.712408] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 is going to be created. [ 611.734337] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.734535] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.734654] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.734961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.735237] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.735451] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.889979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.889979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.889979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.889979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.889979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.889979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e already deleted. [ 611.889979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.922919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.923160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.923256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.923443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.923560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.923659] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 is going to be created. [ 611.959517] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.959744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.959839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.960031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.960233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.978964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: UNINITIALIZED for 2s [ 612.116796] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: SUCCESS [ 612.117118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.117291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.117529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.117722] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.117844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.117947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.118125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.118174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.118287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.118331] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.179936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.179936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.179936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.179936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.179936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.179936] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 612.220546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.220799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.220799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.220965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.221186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.231532] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 612.355084] env[65443]: INFO networking_nsxv3.common.synchronization [None req-757fafc8-59b4-4c47-bc8b-486da5a876fb tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 612.355756] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 612.356075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.356211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.356274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.356543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.356624] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.463571] env[65443]: INFO networking_nsxv3.common.synchronization [req-852c345c-af95-4c91-be9d-f08fcf9ef9cf req-d7a88d4f-6bfb-46b2-98b8-0e5c36c6329a service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 612.463965] env[65443]: INFO networking_nsxv3.common.synchronization [req-852c345c-af95-4c91-be9d-f08fcf9ef9cf req-d7a88d4f-6bfb-46b2-98b8-0e5c36c6329a service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 612.463965] env[65443]: INFO networking_nsxv3.common.synchronization [req-852c345c-af95-4c91-be9d-f08fcf9ef9cf req-d7a88d4f-6bfb-46b2-98b8-0e5c36c6329a service nova] Enqueued Resource ID: 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 with Priority: HIGHEST for action port [ 612.464634] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 612.464781] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 612.464879] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 with Priority: HIGHEST for action port [ 612.465457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.465457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.465457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.465731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.465731] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.465817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.465852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.466165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.466256] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97369f77-4dfb-4cf4-9ab3-0550b1b5b204',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.595372] env[65443]: INFO networking_nsxv3.common.synchronization [None req-567011e3-c3f8-4d10-b02e-2da6f11e5c4b tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 612.596336] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 612.596642] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.596743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.621128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.621299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.621372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.621580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.621832] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.621923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.621956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.622158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.622250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.622340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.622490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.622585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.622647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.622788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.622929] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.623028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.623150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.623269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.623349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.623445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.623521] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.820716] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 612.820716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.820716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.820716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.820716] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.878360] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.878360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 already deleted. [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.878360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.878734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.878734] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.969362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 with status ACTIVE [ 612.969780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.969942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.969942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.970469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.970469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.970628] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.970628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.970729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.970909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.971377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.971377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.971377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.971377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.971945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.971945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.971945] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97369f77-4dfb-4cf4-9ab3-0550b1b5b204 is going to be updated. [ 613.005030] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.005030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.005030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.005030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.005030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.005030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97369f77-4dfb-4cf4-9ab3-0550b1b5b204" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.127032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad: rpc.has_security_group_logging(os_id): False [ 613.161269] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.161513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.161576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.161821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.161959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.162268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.162431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.162510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.162753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.162889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.163408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.163659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.163861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.164168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.164334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.164602] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.165230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.165230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.165230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.165230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.165230] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad is going to be created. [ 613.254028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.254028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.254028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.255387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.255387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.269946] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: IN_PROGRESS for 2s [ 613.322726] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.322973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.409500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.409762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.409851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.410136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.410237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.410342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 already deleted. [ 613.410424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.989337] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: SUCCESS [ 613.989552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.989709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.989914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.990145] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.990223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.990286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.990498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.990610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.990720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.990863] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.246841] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 614.246841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.246841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.246841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.247292] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.247292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.247292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.247473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.247473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.247591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.496152] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.750705] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.002724] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 256b6662-e079-48f2-8a9b-ddfdeb035f28: rpc.has_security_group_logging(os_id): False [ 615.030254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.030254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.030254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.030254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.030841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.030964] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.031177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.031683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.031683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.031683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.031840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 is going to be created. [ 615.115492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.115492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.115492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.115717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.115772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.130424] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: IN_PROGRESS for 2s [ 615.255432] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.284037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: SUCCESS [ 615.284264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.373226] env[65443]: INFO networking_nsxv3.common.synchronization [req-6bfc65b5-2c0a-4edd-8f6d-18928b65c53c req-6ed39651-9312-411d-bd0a-6811e0e84e10 tempest-ServerDiagnosticsTest-673159984 tempest-ServerDiagnosticsTest-673159984-project-member] Enqueued Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 615.376492] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 615.376863] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.376991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.377073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.377331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.377489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.377593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.377950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.378186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.378282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.378400] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.762120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.762120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.762120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.762120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.762120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.762120] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 615.794981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.794981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.794981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.794981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.794981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.808109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 615.814713] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.814911] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.815058] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.816363] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.816731] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.816894] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.817020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.817237] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.817367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.817608] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.817738] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.817838] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.817935] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.818101] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.818216] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.818690] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.838856] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.839068] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.839203] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.839384] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.840210] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-c9173b62-700d-4e6e-a374-8e926cabac3f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.840210] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.840210] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.840407] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.840407] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9173b62-700d-4e6e-a374-8e926cabac3f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.882734] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.882890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.882959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.883212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.883332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.883497] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.883595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.883658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.883804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.883881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.883964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 already deleted. [ 615.884079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.343068] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.343373] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.343511] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.343861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.344059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.344256] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port c9173b62-700d-4e6e-a374-8e926cabac3f not found, creating... [ 616.344567] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.344774] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.344895] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.345201] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.345379] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.345760] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.345962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.346869] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.347167] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.347388] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.347515] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: c9173b62-700d-4e6e-a374-8e926cabac3f is going to be created. [ 616.374100] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.374100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.374100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.374100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.374510] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.375293] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.877885] env[65443]: INFO networking_nsxv3.common.synchronization [req-bb874bd3-5ca3-4a9d-a071-66b53a969ac8 req-dc1bec52-330e-4292-8ba8-5247596ab2c4 tempest-DeleteServersAdminTestJSON-637159166 tempest-DeleteServersAdminTestJSON-637159166-project-admin] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 616.878517] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 616.878976] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.878976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.879258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.880357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.880357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.880357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.880357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.880357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.880357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.880357] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.129517] env[65443]: INFO networking_nsxv3.common.synchronization [req-6bfc65b5-2c0a-4edd-8f6d-18928b65c53c req-67f19668-d0cc-4689-a2dc-7a219036ea20 service nova] Enqueued Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_rules [ 617.129871] env[65443]: INFO networking_nsxv3.common.synchronization [req-6bfc65b5-2c0a-4edd-8f6d-18928b65c53c req-67f19668-d0cc-4689-a2dc-7a219036ea20 service nova] Enqueued Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 617.130048] env[65443]: INFO networking_nsxv3.common.synchronization [req-6bfc65b5-2c0a-4edd-8f6d-18928b65c53c req-67f19668-d0cc-4689-a2dc-7a219036ea20 service nova] Enqueued Resource ID: c9173b62-700d-4e6e-a374-8e926cabac3f with Priority: HIGHEST for action port [ 617.130692] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_rules [ 617.130872] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 617.130980] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9173b62-700d-4e6e-a374-8e926cabac3f with Priority: HIGHEST for action port [ 617.132385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.132565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.132565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.133720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.133720] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.134466] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.134621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.134711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.134852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.135020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.135192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.136340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.136340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.136340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.137349] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.138057] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9173b62-700d-4e6e-a374-8e926cabac3f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.138182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.138256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.138801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.138801] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9173b62-700d-4e6e-a374-8e926cabac3f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.151304] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: SUCCESS [ 617.151515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.385515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.385671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.385981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.385981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.386091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.387414] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.387414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.387414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.387414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.387414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.387414] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be updated. [ 617.423018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.423194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.423276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.423496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.423682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.433731] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 617.641275] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.642554] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.643558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.643995] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9173b62-700d-4e6e-a374-8e926cabac3f with status ACTIVE [ 617.644226] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.644374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.644480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.644694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.645397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.645397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.645613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.645712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.645907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.646078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.646308] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.646786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.647447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.647447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.648049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.648049] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9173b62-700d-4e6e-a374-8e926cabac3f is going to be updated. [ 617.672310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.672490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.672578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.673454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.673624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.673822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9173b62-700d-4e6e-a374-8e926cabac3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.819529] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 617.820085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.820085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.820262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.820396] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.821418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.821418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.821418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.821418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.821418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.821418] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.144453] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.199902] env[65443]: INFO networking_nsxv3.common.synchronization [req-e342c656-d1a2-4015-86c8-2bf87707ad20 req-104a8702-5225-4ed3-a298-49858ee1d892 tempest-ServerExternalEventsTest-1810177272 tempest-ServerExternalEventsTest-1810177272-project-member] Enqueued Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 618.201300] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf with Priority: HIGHEST for action security_group_members [ 618.201300] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.202353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.203352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.203352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.203352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.203352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.203352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.204242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.204397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.204519] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a44c9a5-6f34-40e8-bb18-8fd3522bbccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.325571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.325851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.325851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.326014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.326180] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.326283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.326486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.326486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.326582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.326652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.326790] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.326893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.326937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.327647] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.327647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.328747] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.441699] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfdd0f9c-fc1c-4222-9d49-2643013986c3 req-645d9686-3532-4294-9c6a-6377c701ec81 tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 618.441965] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 618.442584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.442584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.442584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.442779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.442923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.443891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.443891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.443891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.443891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.443891] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.647307] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.647485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.647569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.647815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.647978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.648214] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 is going to be created. [ 618.677068] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.677068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.677068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.677068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.677068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.692905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: UNINITIALIZED for 2s [ 618.709667] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.709903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.711382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.711382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.711382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.712230] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.712230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.712230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.712230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.712230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.712230] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf is going to be updated. [ 618.750394] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.750522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.750821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.751177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.751453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.766032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: IN_PROGRESS for 2s [ 618.830559] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 373eadf5-9140-4fc8-8636-38b8598454fa: rpc.has_security_group_logging(os_id): False [ 618.852200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.852200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.852359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.853048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.853048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.853048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.853048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.853048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.853612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.853806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.854721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.854721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.854721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.854721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.855098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.855135] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.855346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.855702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.855858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.856437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.856437] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 618.931406] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.931406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.931406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.931955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.931955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.946661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.946661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.946661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.947143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.947143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.947143] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.947297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.947297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.947625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.947625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.947625] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e already deleted. [ 618.947848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.950545] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 619.124886] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.125149] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.125225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.125663] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.125879] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.126500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.126500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.126711] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.127623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.127623] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.127623] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 619.127623] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 619.127623] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 619.127623] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 619.127623] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 619.127927] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 619.153088] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 619.153088] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 619.153647] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 619.153647] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.153786] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-af91553a-8d1b-4540-8ae3-b79120e7fe2a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.154043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.154150] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.154506] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.154641] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af91553a-8d1b-4540-8ae3-b79120e7fe2a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.444401] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 619.444401] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb deletion is rescheduled due to dependency. [ 619.444401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.657086] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.657355] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.657355] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.657627] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.657774] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.657926] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port af91553a-8d1b-4540-8ae3-b79120e7fe2a not found, creating... [ 619.658209] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.658359] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.658470] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.658688] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.658845] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.659200] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.659370] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.659484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.659696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.659821] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.659955] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: af91553a-8d1b-4540-8ae3-b79120e7fe2a is going to be created. [ 619.685266] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.685491] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.685626] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.685906] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.686163] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.686385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.408983] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfdd0f9c-fc1c-4222-9d49-2643013986c3 req-38bd8da0-7fd1-4029-bc4d-1a8c2e3594f7 service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 620.409330] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfdd0f9c-fc1c-4222-9d49-2643013986c3 req-38bd8da0-7fd1-4029-bc4d-1a8c2e3594f7 service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 620.409459] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfdd0f9c-fc1c-4222-9d49-2643013986c3 req-38bd8da0-7fd1-4029-bc4d-1a8c2e3594f7 service nova] Enqueued Resource ID: af91553a-8d1b-4540-8ae3-b79120e7fe2a with Priority: HIGHEST for action port [ 620.409973] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 620.413228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 620.413363] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af91553a-8d1b-4540-8ae3-b79120e7fe2a with Priority: HIGHEST for action port [ 620.413675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.413813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.413881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.414252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.414296] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.415599] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.415747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.415798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.416013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.416178] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.416280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.416338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.416492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.418050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.418175] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.423034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-af91553a-8d1b-4540-8ae3-b79120e7fe2a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.423034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.423034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.423034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.423034] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af91553a-8d1b-4540-8ae3-b79120e7fe2a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.703683] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: SUCCESS [ 620.703908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.704142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.704316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.705046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.705046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.705046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.705046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.705046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.705046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.705380] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.781919] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf in Status: SUCCESS [ 620.782084] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a44c9a5-6f34-40e8-bb18-8fd3522bbccf deletion is rescheduled due to dependency. [ 620.783208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a44c9a5-6f34-40e8-bb18-8fd3522bbccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.833947] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ab9b3803-cdcd-4f59-befb-07059b8b6e55 None None] Enqueued Resource ID: c2f25d28-dfe2-4aa6-9114-10e068df1eed with Priority: HIGHEST for action port [ 620.834561] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2f25d28-dfe2-4aa6-9114-10e068df1eed with Priority: HIGHEST for action port [ 620.834890] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2f25d28-dfe2-4aa6-9114-10e068df1eed taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.835019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2f25d28-dfe2-4aa6-9114-10e068df1eed" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.835227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2f25d28-dfe2-4aa6-9114-10e068df1eed" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.835508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2f25d28-dfe2-4aa6-9114-10e068df1eed" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.835596] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2f25d28-dfe2-4aa6-9114-10e068df1eed',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.924106] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.924505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.924857] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.925841] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af91553a-8d1b-4540-8ae3-b79120e7fe2a with status ACTIVE [ 620.926880] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.927153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.927338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.928127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.928127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.928127] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.928127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.928127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.930185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.930185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.930185] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af91553a-8d1b-4540-8ae3-b79120e7fe2a is going to be updated. [ 620.955155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.956905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.956905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.956905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.956905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.956905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af91553a-8d1b-4540-8ae3-b79120e7fe2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.968130] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 620.968130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.208814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.208814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.208814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.209019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.209019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.209636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.209636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.209636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.209636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.210148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.210479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.210479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.210610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.210699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.210851] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.210984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.211071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.212034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.212034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.212034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.212034] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.319948] env[65443]: INFO networking_nsxv3.common.synchronization [req-9a3330e8-9a1f-470c-9cac-af6cb30dca7e req-40c78b40-1844-416a-b638-e85a1561a8bb tempest-ServersTestBootFromVolume-1705188138 tempest-ServersTestBootFromVolume-1705188138-project-member] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 621.319948] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 621.321286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.321812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.321812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.322257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.322589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.322842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.323017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.323791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.323965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.324210] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.338145] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2f25d28-dfe2-4aa6-9114-10e068df1eed [ 621.338399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.338978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.339187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.339367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.339556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.339615] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2f25d28-dfe2-4aa6-9114-10e068df1eed already deleted. [ 621.339716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2f25d28-dfe2-4aa6-9114-10e068df1eed" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.432385] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.715969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a8408b2f-592c-45ed-bf39-d0ac93e874f2: rpc.has_security_group_logging(os_id): False [ 621.737664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.738093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.738188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.738408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.738540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.739034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.739034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.739034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.739201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.739320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.739469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.739568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.739661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.739842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.739914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.743111] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.743111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.743111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.743111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.743111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.743111] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 is going to be created. [ 621.813780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.813923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.814009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.814225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.814399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.828693] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: IN_PROGRESS for 2s [ 621.829363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.829552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.829656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.830162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.830359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.830584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.830690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.830755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.831273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.831443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.831580] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c113e23-4653-415c-8339-d252037cc64b already deleted. [ 621.831721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.940771] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.941128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.941225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.941528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.941623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.941723] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be created. [ 621.986983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.986983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.986983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.986983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.986983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.002983] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: UNINITIALIZED for 2s [ 622.140032] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.140032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.140032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.140032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.141094] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.141567] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.141883] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.142321] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.145022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.145022] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.145022] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.145022] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.145022] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.145022] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.145022] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.145022] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.173713] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.174711] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.174965] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.175405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.176027] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-6162992a-95cc-47fc-9586-2620f2667330 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.176215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.176413] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.176863] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.177195] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6162992a-95cc-47fc-9586-2620f2667330',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.681940] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.682562] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.682721] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.683300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.683967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.684399] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 6162992a-95cc-47fc-9586-2620f2667330 not found, creating... [ 622.684530] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.684698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.684812] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.685058] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.685197] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.685489] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.685640] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.685751] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.686151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.686289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.686512] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 6162992a-95cc-47fc-9586-2620f2667330 is going to be created. [ 622.708727] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.709187] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.709842] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.710218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.710653] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.711342] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.442094] env[65443]: INFO networking_nsxv3.common.synchronization [req-9a3330e8-9a1f-470c-9cac-af6cb30dca7e req-3ca36393-4f35-420f-adf0-aae317f64db5 service nova] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 623.442094] env[65443]: INFO networking_nsxv3.common.synchronization [req-9a3330e8-9a1f-470c-9cac-af6cb30dca7e req-3ca36393-4f35-420f-adf0-aae317f64db5 service nova] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 623.442094] env[65443]: INFO networking_nsxv3.common.synchronization [req-9a3330e8-9a1f-470c-9cac-af6cb30dca7e req-3ca36393-4f35-420f-adf0-aae317f64db5 service nova] Enqueued Resource ID: 6162992a-95cc-47fc-9586-2620f2667330 with Priority: HIGHEST for action port [ 623.442681] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_rules [ 623.442975] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 623.443297] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6162992a-95cc-47fc-9586-2620f2667330 with Priority: HIGHEST for action port [ 623.445270] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.445270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.445270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.445270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.445270] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.447359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.447359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.447666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.449257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.449257] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.449257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.449257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.449257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.449257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.449257] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.450266] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6162992a-95cc-47fc-9586-2620f2667330 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.451023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.451023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.451375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.451649] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6162992a-95cc-47fc-9586-2620f2667330',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.843707] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: SUCCESS [ 623.843964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.951721] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.954310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.954471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.954596] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6162992a-95cc-47fc-9586-2620f2667330 with status ACTIVE [ 623.954755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.954862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.957737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.957995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.958237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.958289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.958396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.958457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.958625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.958703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.958920] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.958990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.959041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.959182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.959251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.959329] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6162992a-95cc-47fc-9586-2620f2667330 is going to be updated. [ 623.986689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.986689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.986689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.986689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.986852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.986905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6162992a-95cc-47fc-9586-2620f2667330" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.016943] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 624.017381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.017911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.018166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.018361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.018475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.018541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.018693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.018785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.018872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.018977] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.072995] env[65443]: INFO networking_nsxv3.common.synchronization [None req-efcae1b4-edf7-41b5-b7cb-b588ffac1ae5 None None] Enqueued Resource ID: 73dec5a7-ba94-474e-a79d-9574890c022d with Priority: HIGHEST for action port [ 624.073838] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73dec5a7-ba94-474e-a79d-9574890c022d with Priority: HIGHEST for action port [ 624.074429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-73dec5a7-ba94-474e-a79d-9574890c022d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.076870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73dec5a7-ba94-474e-a79d-9574890c022d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.076870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73dec5a7-ba94-474e-a79d-9574890c022d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.076870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73dec5a7-ba94-474e-a79d-9574890c022d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.076870] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73dec5a7-ba94-474e-a79d-9574890c022d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.375508] env[65443]: INFO networking_nsxv3.common.synchronization [req-4146587c-5d24-4320-b1a3-4e25577ec913 req-bd1047e0-0be4-4b88-a402-53a9f588dafd tempest-TenantUsagesTestJSON-1937329192 tempest-TenantUsagesTestJSON-1937329192-project-member] Enqueued Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 624.375508] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGHEST for action security_group_members [ 624.375928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.376245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.376444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.376780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.377224] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.377444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.377583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.379142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.379325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.379462] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.456859] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.521450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.521707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.521846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.522306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.522500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.522605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.522667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.522930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.522993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.523099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.523277] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.523393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.523429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.524048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.524048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.524048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.524048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.524781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.524781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.524781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.524781] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.580863] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73dec5a7-ba94-474e-a79d-9574890c022d [ 624.580863] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.580863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.580863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.581169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.581169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.581169] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73dec5a7-ba94-474e-a79d-9574890c022d already deleted. [ 624.581270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73dec5a7-ba94-474e-a79d-9574890c022d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.884375] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.884729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.884729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.884805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.884856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.885858] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.886067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.886321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.887744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.887744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.887744] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 is going to be updated. [ 624.920574] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.920574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.920574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.920574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.920574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.930985] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: IN_PROGRESS for 2s [ 624.958965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.958965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.958965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.959275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.959275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.959362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c113e23-4653-415c-8339-d252037cc64b is going to be created. [ 624.995636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.995868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.995868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.997056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.997356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.015103] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: UNINITIALIZED for 2s [ 625.030814] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1004a68b-2190-4689-9601-8db71d48978e: rpc.has_security_group_logging(os_id): False [ 625.054994] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.055206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.055290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.055534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.055645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.055891] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.056042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.056150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.056375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.056482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.057546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.057546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.057546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.057546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.057546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.057546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.057968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.057968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.057968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.058143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.058196] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be created. [ 625.122665] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e701d02-e80f-4fa6-b3f9-19509ba03b72 req-be4e7194-c95b-4ea1-8d6e-129bc4e4696c tempest-ServersAdminNegativeTestJSON-1088238682 tempest-ServersAdminNegativeTestJSON-1088238682-project-member] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 625.124834] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 625.125443] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.125588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.125664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.126158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.126158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.126348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.126348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.126534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.126627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.126735] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.138178] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.138178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.138178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.138178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.138178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.148820] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 625.446163] env[65443]: INFO networking_nsxv3.common.synchronization [None req-18b06e1d-4eda-4888-9baf-a41382f24c47 None None] Enqueued Resource ID: 0e03847a-601c-4da2-bb9e-c257ced4278a with Priority: HIGHEST for action port [ 625.446853] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e03847a-601c-4da2-bb9e-c257ced4278a with Priority: HIGHEST for action port [ 625.446928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e03847a-601c-4da2-bb9e-c257ced4278a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.447378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e03847a-601c-4da2-bb9e-c257ced4278a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.447378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e03847a-601c-4da2-bb9e-c257ced4278a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.447600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e03847a-601c-4da2-bb9e-c257ced4278a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.447780] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e03847a-601c-4da2-bb9e-c257ced4278a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.524504] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.524762] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.524838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.525263] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.525484] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.525565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.525658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.525877] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.526027] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.526239] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.526347] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.526449] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.526548] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.526647] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.526746] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.526867] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.546475] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.546643] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.547234] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.547234] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.547559] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-8683b5df-2685-4120-ada6-752ee64da4ba taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.547559] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.547690] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.547922] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.548068] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8683b5df-2685-4120-ada6-752ee64da4ba',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.628663] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.949982] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e03847a-601c-4da2-bb9e-c257ced4278a [ 625.950317] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.950399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.950471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.950675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.950764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.950860] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e03847a-601c-4da2-bb9e-c257ced4278a already deleted. [ 625.950954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e03847a-601c-4da2-bb9e-c257ced4278a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.053697] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.053946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.054091] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.054346] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.054503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.054676] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 8683b5df-2685-4120-ada6-752ee64da4ba not found, creating... [ 626.054915] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.055065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.055183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.055387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.055515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.055779] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.055927] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.056049] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.056250] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.056377] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.056507] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 8683b5df-2685-4120-ada6-752ee64da4ba is going to be created. [ 626.079107] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.079360] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.079512] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.079775] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.079995] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.080222] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.130887] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.633984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.634240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.635072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.635400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.636144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.636144] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be updated. [ 626.675371] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.675527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.675578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.676274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.676274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.691890] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 626.886283] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e701d02-e80f-4fa6-b3f9-19509ba03b72 req-3d33372a-35e5-45b1-a43b-67242897da02 service nova] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_rules [ 626.886422] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e701d02-e80f-4fa6-b3f9-19509ba03b72 req-3d33372a-35e5-45b1-a43b-67242897da02 service nova] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 626.886586] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e701d02-e80f-4fa6-b3f9-19509ba03b72 req-3d33372a-35e5-45b1-a43b-67242897da02 service nova] Enqueued Resource ID: 8683b5df-2685-4120-ada6-752ee64da4ba with Priority: HIGHEST for action port [ 626.887254] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_rules [ 626.887485] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 626.887485] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8683b5df-2685-4120-ada6-752ee64da4ba with Priority: HIGHEST for action port [ 626.887810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.887982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.888092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.888350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.888434] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.889453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.890544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.890544] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8683b5df-2685-4120-ada6-752ee64da4ba taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.890544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.890544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.890544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.890544] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8683b5df-2685-4120-ada6-752ee64da4ba',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.944534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 in Status: SUCCESS [ 626.945772] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 deletion is rescheduled due to dependency. [ 626.946937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.032476] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: SUCCESS [ 627.032476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.035579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.035579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.035767] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.035849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.035898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.036067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.036232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.036232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.036387] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.169748] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 627.169748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.263921] env[65443]: INFO networking_nsxv3.common.synchronization [req-e735187a-3026-4105-a1c8-c74721d67c28 req-73a9e5a0-63b9-40cb-abfa-e4c5380f3b0b tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 627.264516] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 627.264802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.264927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.264997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.266293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.266465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.266579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.266645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.266801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.266887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.266984] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.392464] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.392742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.392847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8683b5df-2685-4120-ada6-752ee64da4ba with status ACTIVE [ 627.393082] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.393232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.393346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.393619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.393733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.393919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.394066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.394152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.394357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.394452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.394679] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.394783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.394855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.396038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.396364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.396531] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8683b5df-2685-4120-ada6-752ee64da4ba is going to be updated. [ 627.423623] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.424353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.424353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.424353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.424559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.424803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8683b5df-2685-4120-ada6-752ee64da4ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.541274] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.706924] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.707205] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.707343] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.707683] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.707987] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.708166] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.708293] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.708508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.708696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.708941] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.709157] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.709281] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.709386] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.709512] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.709633] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.709743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.730286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.730666] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.730666] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.731036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.731323] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-89a077dd-0b02-41db-98f1-558117233f56 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.731473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.732678] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.732678] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.734628] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89a077dd-0b02-41db-98f1-558117233f56',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.771011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.771219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.771294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.771490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.771582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.771775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.771898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.773614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.773614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.773614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.773614] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e already deleted. [ 627.773614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.042834] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c113e23-4653-415c-8339-d252037cc64b: rpc.has_security_group_logging(os_id): False [ 628.065618] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.066045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.066045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.066228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.066309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.066649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.066778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.066874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.067737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.067959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.068322] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c113e23-4653-415c-8339-d252037cc64b is going to be created. [ 628.135313] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c8226928-a205-4856-8157-6d4808b0f7a9 None None] Enqueued Resource ID: ff94c62d-9721-4fa7-8f96-40dfb6ea8c65 with Priority: HIGHEST for action port [ 628.135788] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff94c62d-9721-4fa7-8f96-40dfb6ea8c65 with Priority: HIGHEST for action port [ 628.136236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff94c62d-9721-4fa7-8f96-40dfb6ea8c65 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.136383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff94c62d-9721-4fa7-8f96-40dfb6ea8c65" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.136449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff94c62d-9721-4fa7-8f96-40dfb6ea8c65" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.136743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff94c62d-9721-4fa7-8f96-40dfb6ea8c65" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.136858] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff94c62d-9721-4fa7-8f96-40dfb6ea8c65',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.156071] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.156071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.156071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.156071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.156071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.176081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: IN_PROGRESS for 2s [ 628.237998] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.237998] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.238202] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.238620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.238796] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.238956] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 89a077dd-0b02-41db-98f1-558117233f56 not found, creating... [ 628.239274] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.239447] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.239561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.239804] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.239937] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.240244] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.240393] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.240506] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.241255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.241255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.241255] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 89a077dd-0b02-41db-98f1-558117233f56 is going to be created. [ 628.274439] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.274721] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.274789] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.276124] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.277300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.277300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.640313] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff94c62d-9721-4fa7-8f96-40dfb6ea8c65 [ 628.640523] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.640636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.640743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.641102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.641228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.641318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff94c62d-9721-4fa7-8f96-40dfb6ea8c65 already deleted. [ 628.641445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff94c62d-9721-4fa7-8f96-40dfb6ea8c65" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.700551] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 628.700828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.701173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.701446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.701675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.701799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.701886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.702041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.702125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.702226] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.125868] env[65443]: INFO networking_nsxv3.common.synchronization [req-e735187a-3026-4105-a1c8-c74721d67c28 req-bc67bf5b-e9c6-4e99-bc95-5bf348457c64 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 629.126268] env[65443]: INFO networking_nsxv3.common.synchronization [req-e735187a-3026-4105-a1c8-c74721d67c28 req-bc67bf5b-e9c6-4e99-bc95-5bf348457c64 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 629.126341] env[65443]: INFO networking_nsxv3.common.synchronization [req-e735187a-3026-4105-a1c8-c74721d67c28 req-bc67bf5b-e9c6-4e99-bc95-5bf348457c64 service nova] Enqueued Resource ID: 89a077dd-0b02-41db-98f1-558117233f56 with Priority: HIGHEST for action port [ 629.126836] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 629.127055] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 629.127151] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89a077dd-0b02-41db-98f1-558117233f56 with Priority: HIGHEST for action port [ 629.127337] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.127463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.127526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.127986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.127986] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.128684] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.129176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.129176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.129176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.129392] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.129392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.129392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.129907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.129907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.129907] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.131359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-89a077dd-0b02-41db-98f1-558117233f56 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.131505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.131554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.131717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.132333] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89a077dd-0b02-41db-98f1-558117233f56',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.205711] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.634192] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.634567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.634567] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.641148] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89a077dd-0b02-41db-98f1-558117233f56 with status ACTIVE [ 629.641374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.641519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.641592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.641800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.641887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.642169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.642277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.642340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.642510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.642606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.645930] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.645930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.645930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.645930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.645930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.645930] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89a077dd-0b02-41db-98f1-558117233f56 is going to be updated. [ 629.668727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.668880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.669180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.669180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.669331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.669499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89a077dd-0b02-41db-98f1-558117233f56" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.714085] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.142248] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.192173] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: SUCCESS [ 630.192504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.216550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.216707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.216758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.217388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.217388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.217388] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be updated. [ 630.253845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.254286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.254286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.254488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.254553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.265187] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 630.648588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.648588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.648588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.648588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.648588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.648588] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be created. [ 630.680082] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.680082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.680082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.680082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.680082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.691369] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: UNINITIALIZED for 2s [ 632.276552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 632.276994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.276994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.277188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.277415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.277546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.277611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.277964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.278076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.278169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.278261] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.702527] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 632.702737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.702898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.703157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.703359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.703473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.703540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.703826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.703826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.703959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.703959] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.780691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.781069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.781216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.781451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.781647] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.781904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.781904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.782043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.782183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.782183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.782499] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.782499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.782499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.782668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.782736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.782827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.782874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.783023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.783223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.783223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.783355] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.163915] env[65443]: INFO networking_nsxv3.common.synchronization [req-1cb87946-dc77-4f59-a183-99545a20fed7 req-06f5b697-e809-45cb-a7dc-e91d44937d36 tempest-ServerDiagnosticsNegativeTest-649700980 tempest-ServerDiagnosticsNegativeTest-649700980-project-member] Enqueued Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 633.165041] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGHEST for action security_group_members [ 633.165041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.165041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.165041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.167324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.167324] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.167324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.167324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.167324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.167324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.167324] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.207093] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.286318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33573b4-6e20-4958-b534-744277031b44: rpc.has_security_group_logging(os_id): False [ 633.308482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.308766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.308904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.309346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.309516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.310021] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.310157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.310237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.310459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.310573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.310782] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.310913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.310981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.311469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.311620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.311885] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.312405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.312405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.312628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.312806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.312987] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be updated. [ 633.379319] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a0233944-1e94-46c3-a559-fce227cb2677 None None] Enqueued Resource ID: 3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2 with Priority: HIGHEST for action port [ 633.381430] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.381661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.381990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.382293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.382680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.384667] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2 with Priority: HIGHEST for action port [ 633.385355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.385540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.385649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.386102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.386344] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.405137] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 633.669777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.669777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.669777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.670038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.670038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.670619] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.670619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.670619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.670619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.670619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.670619] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad is going to be updated. [ 633.703495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.703733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.703733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.703935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.703977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.709310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 633.714112] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: IN_PROGRESS for 2s [ 633.728533] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.728723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.728863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.729176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.729314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.729627] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.729784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.729906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.730171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.730254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.730347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be created. [ 633.799603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.799742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.800683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.800683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.800683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.815158] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 633.891356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2 [ 633.893669] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.893669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.893669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.893669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.893669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.893669] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2 already deleted. [ 633.893669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3c9a35f7-5e7c-40fa-bca1-11fede7b7dc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.327321] env[65443]: INFO networking_nsxv3.common.synchronization [None req-5b594083-0201-4c35-adeb-bba01cf0061a None None] Enqueued Resource ID: cec3e8de-cc88-421b-b195-31b3fd953952 with Priority: HIGHEST for action port [ 634.327321] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cec3e8de-cc88-421b-b195-31b3fd953952 with Priority: HIGHEST for action port [ 634.327643] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-cec3e8de-cc88-421b-b195-31b3fd953952 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.327643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cec3e8de-cc88-421b-b195-31b3fd953952" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.327643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cec3e8de-cc88-421b-b195-31b3fd953952" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.330998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cec3e8de-cc88-421b-b195-31b3fd953952" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.330998] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cec3e8de-cc88-421b-b195-31b3fd953952',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.415183] env[65443]: INFO networking_nsxv3.common.synchronization [req-c1698801-4324-4eda-bbc0-bbfbb2063f20 req-5c78799b-9ffa-4914-b121-f60cb51cf84c tempest-FloatingIPsAssociationTestJSON-1022144113 tempest-FloatingIPsAssociationTestJSON-1022144113-project-member] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 634.415183] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 634.415183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.415183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.415183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.416999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.416999] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.831699] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cec3e8de-cc88-421b-b195-31b3fd953952 [ 634.831699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.832285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.832285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.832466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.833230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.833230] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cec3e8de-cc88-421b-b195-31b3fd953952 already deleted. [ 634.833230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cec3e8de-cc88-421b-b195-31b3fd953952" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.918905] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.150630] env[65443]: INFO networking_nsxv3.common.synchronization [None req-8c224ba1-0ba4-41ac-a43f-92f575e6d3f0 None None] Enqueued Resource ID: b2f3a8f7-cab9-4983-a972-feff960b955e with Priority: HIGHEST for action port [ 635.152028] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2f3a8f7-cab9-4983-a972-feff960b955e with Priority: HIGHEST for action port [ 635.152252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2f3a8f7-cab9-4983-a972-feff960b955e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.152386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2f3a8f7-cab9-4983-a972-feff960b955e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.152450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2f3a8f7-cab9-4983-a972-feff960b955e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.153045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2f3a8f7-cab9-4983-a972-feff960b955e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.153045] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2f3a8f7-cab9-4983-a972-feff960b955e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.302801] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-221 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.302801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.302801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.302801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.303182] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.303271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.303341] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.303557] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.303667] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.303870] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.304072] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 635.304072] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 635.306077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 635.306077] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 635.306077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 635.306077] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 635.332892] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 635.332892] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 635.332892] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 635.333318] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-221" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.333356] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-9f96c3b4-5d69-4eef-8472-0542882de3f1 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.333547] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.333633] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.333987] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.335273] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f96c3b4-5d69-4eef-8472-0542882de3f1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.373857] env[65443]: INFO networking_nsxv3.common.synchronization [None req-dc2755a3-6f4a-4628-88b4-9ecc3bb64820 None None] Enqueued Resource ID: b0101286-c872-4c6f-b348-b2f7e71a00e6 with Priority: HIGHEST for action port [ 635.373985] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0101286-c872-4c6f-b348-b2f7e71a00e6 with Priority: HIGHEST for action port [ 635.375730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0101286-c872-4c6f-b348-b2f7e71a00e6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.376012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0101286-c872-4c6f-b348-b2f7e71a00e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.376191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0101286-c872-4c6f-b348-b2f7e71a00e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.376461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0101286-c872-4c6f-b348-b2f7e71a00e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.377038] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0101286-c872-4c6f-b348-b2f7e71a00e6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.421356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 635.421588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.421832] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.656244] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2f3a8f7-cab9-4983-a972-feff960b955e [ 635.656712] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.656897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.657030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.657257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.657384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.657509] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2f3a8f7-cab9-4983-a972-feff960b955e already deleted. [ 635.657620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2f3a8f7-cab9-4983-a972-feff960b955e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.727319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad in Status: SUCCESS [ 635.727319] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad deletion is rescheduled due to dependency. [ 635.727319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.829173] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 635.829386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.838187] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.841028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 9f96c3b4-5d69-4eef-8472-0542882de3f1 not found, creating... [ 635.841028] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.841028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.841519] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.841519] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.842415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.842415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.842415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.842761] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 9f96c3b4-5d69-4eef-8472-0542882de3f1 is going to be created. [ 635.868658] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.868658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.868658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.868658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.868658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.868658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.878979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0101286-c872-4c6f-b348-b2f7e71a00e6 [ 635.879993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.879993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.879993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.879993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.880202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.880265] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0101286-c872-4c6f-b348-b2f7e71a00e6 already deleted. [ 635.880577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0101286-c872-4c6f-b348-b2f7e71a00e6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.924160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.924332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.924397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.924607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.924696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.924824] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be updated. [ 636.011783] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.012043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.012043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.012392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.012535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.027316] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 636.419230] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b5a70329-1c25-4e2f-bab1-7db73d7c4770 None None] Enqueued Resource ID: 63532317-5f1a-45d8-aa66-3e04b1f2ea3a with Priority: HIGHEST for action port [ 636.419230] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63532317-5f1a-45d8-aa66-3e04b1f2ea3a with Priority: HIGHEST for action port [ 636.419792] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-63532317-5f1a-45d8-aa66-3e04b1f2ea3a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.419922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63532317-5f1a-45d8-aa66-3e04b1f2ea3a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.419980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63532317-5f1a-45d8-aa66-3e04b1f2ea3a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.421060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63532317-5f1a-45d8-aa66-3e04b1f2ea3a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.421060] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63532317-5f1a-45d8-aa66-3e04b1f2ea3a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [req-c1698801-4324-4eda-bbc0-bbfbb2063f20 req-891f8dad-9d4e-4dd8-ba91-6fdae29723d9 service nova] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_rules [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [req-c1698801-4324-4eda-bbc0-bbfbb2063f20 req-891f8dad-9d4e-4dd8-ba91-6fdae29723d9 service nova] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [req-c1698801-4324-4eda-bbc0-bbfbb2063f20 req-891f8dad-9d4e-4dd8-ba91-6fdae29723d9 service nova] Enqueued Resource ID: 9f96c3b4-5d69-4eef-8472-0542882de3f1 with Priority: HIGHEST for action port [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_rules [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 636.625603] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f96c3b4-5d69-4eef-8472-0542882de3f1 with Priority: HIGHEST for action port [ 636.625603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.625603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.625603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.625603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.625940] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.629626] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.629626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.629626] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f96c3b4-5d69-4eef-8472-0542882de3f1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.629626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.629626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.629626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.629626] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f96c3b4-5d69-4eef-8472-0542882de3f1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.923056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63532317-5f1a-45d8-aa66-3e04b1f2ea3a [ 636.923255] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.923402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.923551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.924043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.924043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.924043] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63532317-5f1a-45d8-aa66-3e04b1f2ea3a already deleted. [ 636.924151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63532317-5f1a-45d8-aa66-3e04b1f2ea3a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.131675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.131871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.132344] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f96c3b4-5d69-4eef-8472-0542882de3f1 with status ACTIVE [ 637.132344] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.132634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.132634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.132911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.132979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.133200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.133309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.133309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.134120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.134120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.134120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.134340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.134340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.135020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.135020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.135020] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f96c3b4-5d69-4eef-8472-0542882de3f1 is going to be updated. [ 637.161455] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.161943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.161943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.162166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.163428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.163428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f96c3b4-5d69-4eef-8472-0542882de3f1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.312744] env[65443]: INFO networking_nsxv3.common.synchronization [req-76c28507-cb82-4398-8ec8-740d2fe091d4 req-0d3cde4f-f564-47c2-9f10-07e007711a8e tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 637.313345] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 637.316369] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.316369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.316369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.316369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.316369] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.317028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.317028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.317028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.317028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.317028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.820853] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.822355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.822355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.822355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.822563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.822764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.823393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.823393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.823491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.823576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.824701] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 already deleted. [ 637.824701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.869018] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.869018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.869018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.869018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.869018] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.869485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.870583] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.871854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.871854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.871854] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.872015] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.873047] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.873047] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.873185] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.873296] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.873546] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.894671] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.894883] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.895071] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.895259] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.895581] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-52808461-db68-48ce-87ec-a31d195f888f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.896074] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.896074] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.896471] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.896854] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52808461-db68-48ce-87ec-a31d195f888f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.043488] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.045577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.045577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.046192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.046192] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.349964] env[65443]: INFO networking_nsxv3.common.synchronization [None req-aa369360-2720-49c5-b968-0139559f32d4 None None] Enqueued Resource ID: 9c9605ab-5671-495c-ae05-c3ff57d40d0d with Priority: HIGHEST for action port [ 638.350706] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c9605ab-5671-495c-ae05-c3ff57d40d0d with Priority: HIGHEST for action port [ 638.351250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c9605ab-5671-495c-ae05-c3ff57d40d0d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.351370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c9605ab-5671-495c-ae05-c3ff57d40d0d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.351449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c9605ab-5671-495c-ae05-c3ff57d40d0d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.351921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c9605ab-5671-495c-ae05-c3ff57d40d0d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.352152] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c9605ab-5671-495c-ae05-c3ff57d40d0d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.399987] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.400210] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.400327] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.400597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.400733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.400874] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 52808461-db68-48ce-87ec-a31d195f888f not found, creating... [ 638.401225] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.401452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.401508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.401700] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.401838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.402174] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.402383] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.402437] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.403945] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.403945] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.403945] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 52808461-db68-48ce-87ec-a31d195f888f is going to be created. [ 638.424625] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.424838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.425781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.425781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.425781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.425781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.552262] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.855506] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9c9605ab-5671-495c-ae05-c3ff57d40d0d [ 638.855506] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.855506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.855506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.855506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.857163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.857163] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9c9605ab-5671-495c-ae05-c3ff57d40d0d already deleted. [ 638.857163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c9605ab-5671-495c-ae05-c3ff57d40d0d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.055303] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.190016] env[65443]: INFO networking_nsxv3.common.synchronization [req-76c28507-cb82-4398-8ec8-740d2fe091d4 req-a992b363-a463-47cb-8d0f-4ddd5d3b834c service nova] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 639.190170] env[65443]: INFO networking_nsxv3.common.synchronization [req-76c28507-cb82-4398-8ec8-740d2fe091d4 req-a992b363-a463-47cb-8d0f-4ddd5d3b834c service nova] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 639.190250] env[65443]: INFO networking_nsxv3.common.synchronization [req-76c28507-cb82-4398-8ec8-740d2fe091d4 req-a992b363-a463-47cb-8d0f-4ddd5d3b834c service nova] Enqueued Resource ID: 52808461-db68-48ce-87ec-a31d195f888f with Priority: HIGHEST for action port [ 639.190791] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 639.190925] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 639.191632] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52808461-db68-48ce-87ec-a31d195f888f with Priority: HIGHEST for action port [ 639.195338] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.195338] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.195338] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.195338] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.195338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.195338] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.196088] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-52808461-db68-48ce-87ec-a31d195f888f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.196088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.196197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.196754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.196754] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52808461-db68-48ce-87ec-a31d195f888f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.559621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.560496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.560575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.564021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.564021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.564021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be updated. [ 639.598791] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.598791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.598791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.598791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.598791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.607534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 639.701027] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.701027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.701027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52808461-db68-48ce-87ec-a31d195f888f with status ACTIVE [ 639.701027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.701027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.701027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.701990] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.702308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.702464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.702696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.702863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.703041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52808461-db68-48ce-87ec-a31d195f888f is going to be updated. [ 639.733548] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.733548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.733548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.733548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.733548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.734700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52808461-db68-48ce-87ec-a31d195f888f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.205643] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.608113] env[65443]: INFO networking_nsxv3.common.synchronization [None req-dc2196d0-22ec-4123-ae51-3befbc0b695a tempest-ServersTestFqdnHostnames-1972796060 tempest-ServersTestFqdnHostnames-1972796060-project-member] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 640.608594] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 640.608912] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.609108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.609172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.609398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.609481] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.710425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.710425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.710639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.712928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.712928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.712928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be created. [ 640.740492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.740649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.740759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.740911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.741108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.754922] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: UNINITIALIZED for 2s [ 640.808997] env[65443]: INFO networking_nsxv3.common.synchronization [None req-f39552c5-f4a6-42c6-afc3-e49ef611a7a6 tempest-ServersTestFqdnHostnames-1972796060 tempest-ServersTestFqdnHostnames-1972796060-project-member] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 640.809642] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 640.810015] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.810574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.132749] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.132935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.132935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.133207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.133344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.133497] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 already deleted. [ 641.133655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.133845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.134053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.134177] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.620944] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.620944] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.620944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.620944] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.655434] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.655434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.655434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.655434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.655434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.655739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 already deleted. [ 641.655739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.122908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.123161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.123273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.123732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.124025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.124191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.124271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.124536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.124631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.124769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.124903] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.125033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.125102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.125265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.125412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.125605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.125605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.125868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.125868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.125929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.126053] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.609087] env[65443]: INFO networking_nsxv3.common.synchronization [None req-bd15558c-f6fa-4f93-9bb4-ff81f7487af5 None None] Enqueued Resource ID: 13faac73-6d89-480c-b9da-ea016f26ba81 with Priority: HIGHEST for action port [ 642.610013] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 13faac73-6d89-480c-b9da-ea016f26ba81 with Priority: HIGHEST for action port [ 642.611039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-13faac73-6d89-480c-b9da-ea016f26ba81 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.612369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-13faac73-6d89-480c-b9da-ea016f26ba81" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.612369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-13faac73-6d89-480c-b9da-ea016f26ba81" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.612694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-13faac73-6d89-480c-b9da-ea016f26ba81" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.612756] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('13faac73-6d89-480c-b9da-ea016f26ba81',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.632211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e1792da-b313-46fc-bec2-ab5ddb70bee3: rpc.has_security_group_logging(os_id): False [ 642.651981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.652217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.652955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.653333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.653663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.653663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.653985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.654137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.654332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.654436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.654663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.654763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.654827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.655081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.655081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.655274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.655347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.655400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.656065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.656065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.656065] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be updated. [ 642.728264] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.728264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.728264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.728264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.728264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.744132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 642.764384] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 642.765279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.765279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.765279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.765666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.765666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.765666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.765666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.765830] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.117182] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 13faac73-6d89-480c-b9da-ea016f26ba81 [ 643.117598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.118147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.118147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.118258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.118432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.118724] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:13faac73-6d89-480c-b9da-ea016f26ba81 already deleted. [ 643.118724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-13faac73-6d89-480c-b9da-ea016f26ba81" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.269681] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.773877] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 338befad-e097-41dd-903a-b87985d12b22: rpc.has_security_group_logging(os_id): False [ 643.795427] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.795893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.795893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.796217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.796569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.796674] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.797561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.797561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.797561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.797561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.797561] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be created. [ 643.870278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.870445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.870516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.870725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.870903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.887701] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 644.769027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 644.769027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.902270] env[65443]: INFO networking_nsxv3.common.synchronization [req-5c926cf6-aca7-48a5-9686-c7b3b47fc360 req-42a25232-3229-4a31-8a4c-8eead4617350 tempest-ImagesOneServerTestJSON-1207735951 tempest-ImagesOneServerTestJSON-1207735951-project-member] Enqueued Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 644.902270] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 644.902270] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.902270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.902270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.902270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.902809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.902809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.902809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.902809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.902809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.903051] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.406123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.406438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.406527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.406782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.406963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.407405] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.407405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.407576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.408143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.408143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.408143] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 already deleted. [ 645.408143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.618030] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a6b6189d-19be-4b9c-a914-185f175d429f None None] Enqueued Resource ID: 110b2529-16d9-4e03-83e6-a70e2c74708b with Priority: HIGHEST for action port [ 645.618030] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 110b2529-16d9-4e03-83e6-a70e2c74708b with Priority: HIGHEST for action port [ 645.618330] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-110b2529-16d9-4e03-83e6-a70e2c74708b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.618700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-110b2529-16d9-4e03-83e6-a70e2c74708b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.618891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-110b2529-16d9-4e03-83e6-a70e2c74708b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.619850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-110b2529-16d9-4e03-83e6-a70e2c74708b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.620178] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('110b2529-16d9-4e03-83e6-a70e2c74708b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.684574] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.684763] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-546" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.684880] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-546" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.685331] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-546" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.685618] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.685855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.685972] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.686521] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.686683] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.686890] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.687356] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.687541] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.687665] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.687778] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 645.687879] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.688018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.722607] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.722607] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 645.722607] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.722607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-546" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.722607] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.722607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.722607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.722607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.722607] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a3e8e99-abef-422c-b8d3-59a7ab2b7b94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.811349] env[65443]: INFO networking_nsxv3.common.synchronization [None req-14d2cfb3-0613-4410-814b-5afa680e2701 None None] Enqueued Resource ID: 9322bfa3-3a88-4618-99f8-fbeba610a854 with Priority: HIGHEST for action port [ 645.811811] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9322bfa3-3a88-4618-99f8-fbeba610a854 with Priority: HIGHEST for action port [ 645.812407] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9322bfa3-3a88-4618-99f8-fbeba610a854 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.812407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9322bfa3-3a88-4618-99f8-fbeba610a854" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.812407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9322bfa3-3a88-4618-99f8-fbeba610a854" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.812691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9322bfa3-3a88-4618-99f8-fbeba610a854" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.812691] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9322bfa3-3a88-4618-99f8-fbeba610a854',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.900266] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 645.900664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.123646] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 110b2529-16d9-4e03-83e6-a70e2c74708b [ 646.124720] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.124720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.124720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.124720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.124720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.124720] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:110b2529-16d9-4e03-83e6-a70e2c74708b already deleted. [ 646.125025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-110b2529-16d9-4e03-83e6-a70e2c74708b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.226043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.226043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.226043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.226376] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.226376] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.226484] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 not found, creating... [ 646.226737] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.227036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.227036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.228099] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.228099] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.228099] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.228099] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.228099] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.228461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.228461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.228616] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 is going to be created. [ 646.253042] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.253042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.253042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.253042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.253042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.253042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.318480] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9322bfa3-3a88-4618-99f8-fbeba610a854 [ 646.318747] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.318883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.318995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.319188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.320135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.320135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9322bfa3-3a88-4618-99f8-fbeba610a854 already deleted. [ 646.320135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9322bfa3-3a88-4618-99f8-fbeba610a854" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.989835] env[65443]: INFO networking_nsxv3.common.synchronization [req-5c926cf6-aca7-48a5-9686-c7b3b47fc360 req-29c77c11-bef7-4a5d-9aa5-302dee96ad70 service nova] Enqueued Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_rules [ 646.990095] env[65443]: INFO networking_nsxv3.common.synchronization [req-5c926cf6-aca7-48a5-9686-c7b3b47fc360 req-29c77c11-bef7-4a5d-9aa5-302dee96ad70 service nova] Enqueued Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 646.990266] env[65443]: INFO networking_nsxv3.common.synchronization [req-5c926cf6-aca7-48a5-9686-c7b3b47fc360 req-29c77c11-bef7-4a5d-9aa5-302dee96ad70 service nova] Enqueued Resource ID: 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 with Priority: HIGHEST for action port [ 646.990873] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_rules [ 646.991699] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 646.991770] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 with Priority: HIGHEST for action port [ 646.992155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.992294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.992350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.992965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.992965] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.996539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.996539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.996539] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.996539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.996539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.997255] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a3e8e99-abef-422c-b8d3-59a7ab2b7b94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.323881] env[65443]: INFO networking_nsxv3.common.synchronization [req-15b575c3-fe31-4751-8d32-0a45e3a5248e req-11dde2b4-35f3-4f9c-9779-fb3e36997ce3 tempest-ServerDiagnosticsTest-673159984 tempest-ServerDiagnosticsTest-673159984-project-member] Enqueued Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 647.324566] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 with Priority: HIGHEST for action security_group_members [ 647.324800] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a8408b2f-592c-45ed-bf39-d0ac93e874f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.326676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.326793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.326890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.326961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.327119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.327205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.327299] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a8408b2f-592c-45ed-bf39-d0ac93e874f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.498805] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.501633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.501633] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.502292] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 with status ACTIVE [ 647.502548] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.504663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.504663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.504663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.505356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.505356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.507472] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a3e8e99-abef-422c-b8d3-59a7ab2b7b94 is going to be updated. [ 647.531549] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.531751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.531846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.532145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.532344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.532583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a3e8e99-abef-422c-b8d3-59a7ab2b7b94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.829825] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.830160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.830160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.830266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.830357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.830551] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.830663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.830704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.830845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.830923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.831012] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 is going to be updated. [ 647.863849] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.863849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.864135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.864174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.864331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.876753] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: IN_PROGRESS for 2s [ 648.009150] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.223163] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3ef8e30b-f3bc-4792-9b89-8d6cec77c8ae None None] Enqueued Resource ID: ed836384-c654-4864-80b5-96ff79558e52 with Priority: HIGHEST for action port [ 648.223756] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed836384-c654-4864-80b5-96ff79558e52 with Priority: HIGHEST for action port [ 648.224066] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed836384-c654-4864-80b5-96ff79558e52 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.224614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed836384-c654-4864-80b5-96ff79558e52" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.224614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed836384-c654-4864-80b5-96ff79558e52" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.224614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed836384-c654-4864-80b5-96ff79558e52" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.224614] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed836384-c654-4864-80b5-96ff79558e52',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.358131] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ec8c4826-4c79-41bb-8552-3481833c285f None None] Enqueued Resource ID: 603b82a8-e8c9-4325-8aae-f46bd73b09ec with Priority: HIGHEST for action port [ 648.358131] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 603b82a8-e8c9-4325-8aae-f46bd73b09ec with Priority: HIGHEST for action port [ 648.358131] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-603b82a8-e8c9-4325-8aae-f46bd73b09ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.358131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-603b82a8-e8c9-4325-8aae-f46bd73b09ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.358131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-603b82a8-e8c9-4325-8aae-f46bd73b09ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.358131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-603b82a8-e8c9-4325-8aae-f46bd73b09ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.358131] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('603b82a8-e8c9-4325-8aae-f46bd73b09ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.512777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.514027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.514027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.514027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.514027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.514027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 is going to be created. [ 648.537678] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.537775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.538135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.538766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.538766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.548518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: UNINITIALIZED for 2s [ 648.728110] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed836384-c654-4864-80b5-96ff79558e52 [ 648.728110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.728110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.728110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.729876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.729876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.729876] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed836384-c654-4864-80b5-96ff79558e52 already deleted. [ 648.729876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed836384-c654-4864-80b5-96ff79558e52" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.844549] env[65443]: INFO networking_nsxv3.common.synchronization [req-8447b26b-8af1-4ef6-8044-50176788a44e req-55768635-9dcd-47db-94f5-b9c06dc31364 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 648.849020] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 648.849020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.849020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.849020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.849020] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.862197] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 603b82a8-e8c9-4325-8aae-f46bd73b09ec [ 648.862197] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.862197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.862197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.862197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.862197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.862197] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:603b82a8-e8c9-4325-8aae-f46bd73b09ec already deleted. [ 648.862197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-603b82a8-e8c9-4325-8aae-f46bd73b09ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.264183] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.264452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.264621] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.265353] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.265843] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.266178] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.266379] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.266788] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.267031] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.267359] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.267876] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.268762] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.268982] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.269211] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.270025] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.270271] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.277993] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c69f8c1b-6481-43aa-a2ff-caf6cd726a83 None None] Enqueued Resource ID: 5660a962-3c12-400b-ae27-ffd4a59d4718 with Priority: HIGHEST for action port [ 649.279472] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5660a962-3c12-400b-ae27-ffd4a59d4718 with Priority: HIGHEST for action port [ 649.279903] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-5660a962-3c12-400b-ae27-ffd4a59d4718 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.280209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5660a962-3c12-400b-ae27-ffd4a59d4718" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.280316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5660a962-3c12-400b-ae27-ffd4a59d4718" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.280657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5660a962-3c12-400b-ae27-ffd4a59d4718" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.280764] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5660a962-3c12-400b-ae27-ffd4a59d4718',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.326230] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.326607] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.056 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.326825] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.327087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.327485] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-25bfccf2-d695-42d6-89cd-605a646555ba taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.327671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.327835] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.328111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.328237] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25bfccf2-d695-42d6-89cd-605a646555ba',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.349996] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.350166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.350237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.350453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.350617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.350832] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.350933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.350994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.351228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.351490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.351598] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 already deleted. [ 649.351695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.782689] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5660a962-3c12-400b-ae27-ffd4a59d4718 [ 649.782950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.783232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.783232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.784029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.784029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.784029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5660a962-3c12-400b-ae27-ffd4a59d4718 already deleted. [ 649.784313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5660a962-3c12-400b-ae27-ffd4a59d4718" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.831711] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.832974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.832974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.832974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.832974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.832974] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 25bfccf2-d695-42d6-89cd-605a646555ba not found, creating... [ 649.832974] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.833406] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.833406] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.833406] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.833526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.833766] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.834350] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.834350] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.835532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.835532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.835532] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 25bfccf2-d695-42d6-89cd-605a646555ba is going to be created. [ 649.860690] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.860928] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.861033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.861602] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.861602] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.861837] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.890734] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 in Status: SUCCESS [ 649.890734] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a8408b2f-592c-45ed-bf39-d0ac93e874f2 deletion is rescheduled due to dependency. [ 649.890734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a8408b2f-592c-45ed-bf39-d0ac93e874f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.013782] env[65443]: INFO networking_nsxv3.common.synchronization [None req-11596b0e-cf5b-4a84-8aa8-dbe0235c9137 None None] Enqueued Resource ID: 23b95258-3458-4bcd-8bbe-0e7387538768 with Priority: HIGHEST for action port [ 650.016150] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23b95258-3458-4bcd-8bbe-0e7387538768 with Priority: HIGHEST for action port [ 650.016150] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-23b95258-3458-4bcd-8bbe-0e7387538768 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.016150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23b95258-3458-4bcd-8bbe-0e7387538768" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.016150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23b95258-3458-4bcd-8bbe-0e7387538768" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.016150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23b95258-3458-4bcd-8bbe-0e7387538768" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.016150] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23b95258-3458-4bcd-8bbe-0e7387538768',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.518957] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23b95258-3458-4bcd-8bbe-0e7387538768 [ 650.519248] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.519389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.519459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.519717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.519820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.520489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23b95258-3458-4bcd-8bbe-0e7387538768 already deleted. [ 650.520829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23b95258-3458-4bcd-8bbe-0e7387538768" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.554057] env[65443]: INFO networking_nsxv3.common.synchronization [req-8447b26b-8af1-4ef6-8044-50176788a44e req-47e86ae8-c59f-4bd8-9129-94a59987356b service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 650.554388] env[65443]: INFO networking_nsxv3.common.synchronization [req-8447b26b-8af1-4ef6-8044-50176788a44e req-47e86ae8-c59f-4bd8-9129-94a59987356b service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 650.554799] env[65443]: INFO networking_nsxv3.common.synchronization [req-8447b26b-8af1-4ef6-8044-50176788a44e req-47e86ae8-c59f-4bd8-9129-94a59987356b service nova] Enqueued Resource ID: 25bfccf2-d695-42d6-89cd-605a646555ba with Priority: HIGHEST for action port [ 650.555250] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 650.555677] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 650.555677] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25bfccf2-d695-42d6-89cd-605a646555ba with Priority: HIGHEST for action port [ 650.555908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.556035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.556035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.557146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.557146] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.557502] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.557502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.557632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.557787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.558042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.558475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.558620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.558898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.559105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.559351] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.560420] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-25bfccf2-d695-42d6-89cd-605a646555ba taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.560996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.560996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.560996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.564045] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25bfccf2-d695-42d6-89cd-605a646555ba',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.564045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: SUCCESS [ 650.564045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.564811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.565087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.565442] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.566156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.566156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.566156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.566156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.566341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.566341] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.064231] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.065593] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.065593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.068963] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25bfccf2-d695-42d6-89cd-605a646555ba with status ACTIVE [ 651.068963] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.069276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.069276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.069464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.069641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.069833] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.070039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.070107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.070391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.070533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.070746] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.072916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.073535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.073761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.073813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.073910] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25bfccf2-d695-42d6-89cd-605a646555ba is going to be updated. [ 651.091512] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.091671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.092135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.092135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.092135] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.092367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.092367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.092460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.092495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.093217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.093217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.093217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.093647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.093647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.093647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.093647] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.101055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.101055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.101055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.101055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.101055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.101055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25bfccf2-d695-42d6-89cd-605a646555ba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.569535] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.596173] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9c98539-6490-4aa2-80d1-381c6299bd04: rpc.has_security_group_logging(os_id): False [ 651.619275] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.619458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.619524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.619726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.619812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.619956] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.620061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.620117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.620275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.622162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.622162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.622162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.622162] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 is going to be created. [ 651.697346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.698339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.698429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.698665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.698984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.714917] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: IN_PROGRESS for 2s [ 652.073988] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.073988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.073988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.073988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.074452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.074452] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be created. [ 652.100882] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.101158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.101158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.101326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.101481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.113433] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: UNINITIALIZED for 2s [ 652.492424] env[65443]: INFO networking_nsxv3.common.synchronization [None req-6ae87636-7888-479b-a6bd-9d469ada4f17 None None] Enqueued Resource ID: 90640723-acdc-41f3-9891-3a67f8651142 with Priority: HIGHEST for action port [ 652.493327] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90640723-acdc-41f3-9891-3a67f8651142 with Priority: HIGHEST for action port [ 652.493327] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-90640723-acdc-41f3-9891-3a67f8651142 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.494212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90640723-acdc-41f3-9891-3a67f8651142" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.494212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90640723-acdc-41f3-9891-3a67f8651142" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.494212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90640723-acdc-41f3-9891-3a67f8651142" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.494212] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90640723-acdc-41f3-9891-3a67f8651142',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.997479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90640723-acdc-41f3-9891-3a67f8651142 [ 652.997805] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.997988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.999439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.999706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.999801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.001077] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90640723-acdc-41f3-9891-3a67f8651142 already deleted. [ 653.001077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90640723-acdc-41f3-9891-3a67f8651142" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.333265] env[65443]: INFO networking_nsxv3.common.synchronization [req-cdd51786-4f3c-4c52-bb37-063a0bd22e93 req-ca751a6d-f16d-4011-b266-e5126c503b9f tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 653.333620] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 653.334121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.334121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.334121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.334301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.334825] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.334825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.334825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.334825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.334825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.335108] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.728556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: SUCCESS [ 653.728828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.817970] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.818139] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.818289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.818678] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.818848] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.818848] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.819058] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.821546] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.821714] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.821930] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.822728] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.822845] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.822989] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.823113] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.823234] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.823365] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.841630] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.848762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.849469] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.849469] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.849469] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.849798] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-7de851c5-46f1-4c5f-85a1-4eb851049645 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.853486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.853486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.853486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.853486] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de851c5-46f1-4c5f-85a1-4eb851049645',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.124161] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 654.124474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.124665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.124918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.125209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.125338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.125462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.125791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.125906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.125991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.126131] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.345439] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.355947] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.356638] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.356890] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.357228] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.357385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.357542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 7de851c5-46f1-4c5f-85a1-4eb851049645 not found, creating... [ 654.357832] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.357989] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.358189] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.358336] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.358499] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.358780] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.359214] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.359335] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.359544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.359901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.360151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 7de851c5-46f1-4c5f-85a1-4eb851049645 is going to be created. [ 654.383986] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.384265] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.384352] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.384588] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.384937] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.385097] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.628504] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.628756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.628866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.629214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.629431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.629568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.629652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.629861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.629976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.630110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.630304] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.630687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.630687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.630687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.630862] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.630978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.631072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.631268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.631366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.631477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.631597] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.849032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.849032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.849032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 654.884076] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.884076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.884076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.884507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.884507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.897052] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 655.134528] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 655.161495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.161621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.161688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.161907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.162054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.162704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.162704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.162704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.162704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.162998] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.162998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.162998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.163150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.163250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.163411] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.163587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.163587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.164200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.164200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.164482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be created. [ 655.205027] env[65443]: INFO networking_nsxv3.common.synchronization [req-cdd51786-4f3c-4c52-bb37-063a0bd22e93 req-a0933863-16f3-473c-820f-2ecf8891c5ed service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 655.205027] env[65443]: INFO networking_nsxv3.common.synchronization [req-cdd51786-4f3c-4c52-bb37-063a0bd22e93 req-a0933863-16f3-473c-820f-2ecf8891c5ed service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 655.205027] env[65443]: INFO networking_nsxv3.common.synchronization [req-cdd51786-4f3c-4c52-bb37-063a0bd22e93 req-a0933863-16f3-473c-820f-2ecf8891c5ed service nova] Enqueued Resource ID: 7de851c5-46f1-4c5f-85a1-4eb851049645 with Priority: HIGHEST for action port [ 655.205027] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 655.205027] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 655.207218] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7de851c5-46f1-4c5f-85a1-4eb851049645 with Priority: HIGHEST for action port [ 655.207218] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.207218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.207218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.207218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.207218] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.207678] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.207678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.207756] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7de851c5-46f1-4c5f-85a1-4eb851049645 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.207834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.207873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.208042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.208117] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7de851c5-46f1-4c5f-85a1-4eb851049645',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.240134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.240134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.240134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.240134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.240134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.252307] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 655.710335] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7de851c5-46f1-4c5f-85a1-4eb851049645 with status ACTIVE [ 655.710848] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.710966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.710966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.711307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.711419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.711591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.711707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.711774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.711945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.712035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.712277] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.712420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.712420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.712571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.712571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.712679] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7de851c5-46f1-4c5f-85a1-4eb851049645 is going to be updated. [ 655.715805] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.715805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.739865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.739865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.739865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.740149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.740149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.740343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7de851c5-46f1-4c5f-85a1-4eb851049645" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.845915] env[65443]: INFO networking_nsxv3.common.synchronization [req-34fee121-368b-4ee9-bb38-ee663e4cbfa7 req-0b835233-1514-4ea9-9f07-2c6cc6433309 tempest-DeleteServersAdminTestJSON-386804794 tempest-DeleteServersAdminTestJSON-386804794-project-member] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 655.846173] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 655.846559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.846697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.846789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.846993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.847346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.847463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.847525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.847672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.847762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.847860] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.350598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.350811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.350968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.352336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.352336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.352336] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.352336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.352336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.352679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.352679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.352679] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be updated. [ 656.378284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.378448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.378493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.378682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.378823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.390204] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 656.558452] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.562029] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.562029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.562029] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.562029] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.562029] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.562029] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.562029] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.562029] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.562029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.579999] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.580145] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.580241] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.580575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.580709] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-f3d8b669-9925-48d0-b4af-c306ecfddb6d taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.580880] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.580994] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.581454] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.581519] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d8b669-9925-48d0-b4af-c306ecfddb6d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.908546] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 656.908924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.908924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.909129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.909311] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.909425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.909511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.909695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.909793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.909894] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.085363] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.085640] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.085776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.086401] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.086401] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.086401] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port f3d8b669-9925-48d0-b4af-c306ecfddb6d not found, creating... [ 657.086601] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.086755] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.086960] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.087225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.087422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.087838] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.088030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.088144] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.088738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.088738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.088848] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: f3d8b669-9925-48d0-b4af-c306ecfddb6d is going to be created. [ 657.116387] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.116619] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.116786] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.116963] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.117205] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.117413] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.264845] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 657.265123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.412434] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.856519] env[65443]: INFO networking_nsxv3.common.synchronization [req-34fee121-368b-4ee9-bb38-ee663e4cbfa7 req-682a8978-70a7-4adc-821e-a230551485a4 service nova] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_rules [ 657.856519] env[65443]: INFO networking_nsxv3.common.synchronization [req-34fee121-368b-4ee9-bb38-ee663e4cbfa7 req-682a8978-70a7-4adc-821e-a230551485a4 service nova] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 657.856519] env[65443]: INFO networking_nsxv3.common.synchronization [req-34fee121-368b-4ee9-bb38-ee663e4cbfa7 req-682a8978-70a7-4adc-821e-a230551485a4 service nova] Enqueued Resource ID: f3d8b669-9925-48d0-b4af-c306ecfddb6d with Priority: HIGHEST for action port [ 657.856519] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_rules [ 657.856814] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 657.857050] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3d8b669-9925-48d0-b4af-c306ecfddb6d with Priority: HIGHEST for action port [ 657.857776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.858075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.858271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.858956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.861026] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.861026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3d8b669-9925-48d0-b4af-c306ecfddb6d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.861026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.861026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.861852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.861941] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3d8b669-9925-48d0-b4af-c306ecfddb6d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.915019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.364848] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.364986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.365207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3d8b669-9925-48d0-b4af-c306ecfddb6d with status ACTIVE [ 658.365399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.365515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.365583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.366098] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.366285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.366285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.366358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.366450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.367843] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.367843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.367843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.367843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.367843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.367843] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3d8b669-9925-48d0-b4af-c306ecfddb6d is going to be updated. [ 658.394920] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.395102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.395148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.395358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.395495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.395656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3d8b669-9925-48d0-b4af-c306ecfddb6d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405667] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 658.405667] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb deletion is rescheduled due to dependency. [ 658.405906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.405946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.406153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.406335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.406445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.406499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.406656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.406730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.406824] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.417897] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.417897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.417897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.418260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.418260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.418260] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 658.455061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.455061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.455061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.455364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.455404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.465147] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 658.536852] env[65443]: INFO networking_nsxv3.common.synchronization [req-f966857c-3f76-4743-a016-8eb38b304b40 req-69afe212-2e36-40b6-bac2-6d54efacc994 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 658.536852] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 658.536852] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.536852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.536852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.536852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.536852] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.536852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.537451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.537451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.537451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.537451] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.910841] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.917376] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.917653] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.917692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.917961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.918232] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.918384] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.918505] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.918719] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.918856] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.919193] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.919411] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.919524] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.919626] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.919747] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.919850] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.919970] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.940370] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.940441] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.942685] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.942685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.942685] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a583589c-8039-46c8-8a5c-147d6853decf taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.942685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.942685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.942685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.942685] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a583589c-8039-46c8-8a5c-147d6853decf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.039884] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.040078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.040155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.040344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.040436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.040633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.040747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.040833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.040909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.040980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.041073] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 already deleted. [ 659.041154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.413705] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.444111] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.444364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.444434] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.444699] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.444840] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.444983] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a583589c-8039-46c8-8a5c-147d6853decf not found, creating... [ 659.445258] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.445402] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.445509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.445721] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.445843] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.446117] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.446261] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.446369] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.446564] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.446682] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.446812] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a583589c-8039-46c8-8a5c-147d6853decf is going to be created. [ 659.469265] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.469777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.469978] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.470311] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.470574] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.470836] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.917578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.917578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.918056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.918965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.918965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.918965] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be updated. [ 659.958397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.958397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.958397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.958608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.959051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.972843] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 660.231793] env[65443]: INFO networking_nsxv3.common.synchronization [req-f966857c-3f76-4743-a016-8eb38b304b40 req-f1459adc-f8b0-432e-96e2-6e7067602abb service nova] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_rules [ 660.232054] env[65443]: INFO networking_nsxv3.common.synchronization [req-f966857c-3f76-4743-a016-8eb38b304b40 req-f1459adc-f8b0-432e-96e2-6e7067602abb service nova] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 660.232437] env[65443]: INFO networking_nsxv3.common.synchronization [req-f966857c-3f76-4743-a016-8eb38b304b40 req-f1459adc-f8b0-432e-96e2-6e7067602abb service nova] Enqueued Resource ID: a583589c-8039-46c8-8a5c-147d6853decf with Priority: HIGHEST for action port [ 660.232835] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_rules [ 660.232978] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 660.233657] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a583589c-8039-46c8-8a5c-147d6853decf with Priority: HIGHEST for action port [ 660.233657] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.233657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.233986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.234123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.234123] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.236884] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.236884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.236884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.237097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.239149] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.239328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.239391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.239635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.239738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.239850] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.241573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a583589c-8039-46c8-8a5c-147d6853decf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.241732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.241814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.243152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.243152] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a583589c-8039-46c8-8a5c-147d6853decf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.477576] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.478800] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.478800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.480117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.480117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.480117] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.747319] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.747319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.747319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a583589c-8039-46c8-8a5c-147d6853decf with status ACTIVE [ 660.747319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.747319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.747319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.748323] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.748571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.748745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.748994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.749294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.749490] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a583589c-8039-46c8-8a5c-147d6853decf is going to be updated. [ 660.773452] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.773677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.773779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.774029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.774169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.774331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a583589c-8039-46c8-8a5c-147d6853decf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.991808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.991808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.991808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.991808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.991808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.994145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.994145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.994145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.994145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.994145] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.253993] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.489374] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 373eadf5-9140-4fc8-8636-38b8598454fa: rpc.has_security_group_logging(os_id): False [ 661.511059] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511059] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511059] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.511059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.511928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.511928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.511928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.511928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.511928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.511928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 661.581052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.581383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.581383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.582172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.582172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.598529] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 661.754385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.754720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.754720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.755547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.755547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.755547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be created. [ 661.781150] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.781379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.781435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.781668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.781855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.795993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: UNINITIALIZED for 2s [ 661.905588] env[65443]: INFO networking_nsxv3.common.synchronization [req-494b7b51-d097-4741-a994-6ac1db0ecb01 req-5d3f0724-4802-4bb9-9538-c8d0e6cd7286 tempest-ServerAddressesTestJSON-297973440 tempest-ServerAddressesTestJSON-297973440-project-member] Enqueued Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 661.905765] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 661.906094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.906223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.906283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.906548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.906707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.906799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.906856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.907019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.907109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.907209] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.983742] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.986017] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.986017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.986017] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.360650] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.361103] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-454" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.361103] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-454" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.361523] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-454" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.361792] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.361951] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.362073] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.362294] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.362448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.362678] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.362798] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 662.362918] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 662.363040] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 662.363177] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 662.363264] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 662.363406] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 662.384849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 662.385158] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 662.385396] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 662.385634] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-454" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.386046] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-e14a902d-0c13-4946-bdb8-5548cdfca057 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.386281] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.386423] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.386757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.386914] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14a902d-0c13-4946-bdb8-5548cdfca057',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.412122] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.412272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.412525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.412798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.412919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.413160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.413284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.413356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.413543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.413641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.413743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 already deleted. [ 662.413842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.493561] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.493899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.493899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.494109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.494280] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.494832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.494832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.494832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.494832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.495143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.495143] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.495235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.495235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.495668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.495733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.495870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.495946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.496039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.496130] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.891544] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.891544] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port e14a902d-0c13-4946-bdb8-5548cdfca057 not found, creating... [ 662.891544] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.891544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.892024] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.892024] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.892723] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.892723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.892723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.892978] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.892978] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.893070] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: e14a902d-0c13-4946-bdb8-5548cdfca057 is going to be created. [ 662.918383] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.918622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.918622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.918887] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.919113] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.919414] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.000993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0fe6210d-3498-4e0f-b810-00e0478f00cb: rpc.has_security_group_logging(os_id): False [ 663.034595] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.034753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.034826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.035068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.035183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.035470] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.035584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.035647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.035812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.035891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.036125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.036244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.036313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.036465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.036542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.036726] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.036899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.036968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.037130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.037224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.037321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be updated. [ 663.137149] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.137436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.138414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.138636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.138793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.154542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 663.581233] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c452a0f8-37f7-43e6-8736-bfdde30c3f9b None None] Enqueued Resource ID: 2201242c-e887-4d42-96cb-9aa9f289aab8 with Priority: HIGHEST for action port [ 663.581233] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2201242c-e887-4d42-96cb-9aa9f289aab8 with Priority: HIGHEST for action port [ 663.581233] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2201242c-e887-4d42-96cb-9aa9f289aab8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.581233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2201242c-e887-4d42-96cb-9aa9f289aab8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.581233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2201242c-e887-4d42-96cb-9aa9f289aab8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.581233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2201242c-e887-4d42-96cb-9aa9f289aab8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.581233] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2201242c-e887-4d42-96cb-9aa9f289aab8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.625340] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 663.626582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.696873] env[65443]: INFO networking_nsxv3.common.synchronization [req-494b7b51-d097-4741-a994-6ac1db0ecb01 req-c8f0a33e-a21a-4396-822e-7717c2584ff8 service nova] Enqueued Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_rules [ 663.697298] env[65443]: INFO networking_nsxv3.common.synchronization [req-494b7b51-d097-4741-a994-6ac1db0ecb01 req-c8f0a33e-a21a-4396-822e-7717c2584ff8 service nova] Enqueued Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 663.697462] env[65443]: INFO networking_nsxv3.common.synchronization [req-494b7b51-d097-4741-a994-6ac1db0ecb01 req-c8f0a33e-a21a-4396-822e-7717c2584ff8 service nova] Enqueued Resource ID: e14a902d-0c13-4946-bdb8-5548cdfca057 with Priority: HIGHEST for action port [ 663.698308] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_rules [ 663.698308] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 663.698516] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e14a902d-0c13-4946-bdb8-5548cdfca057 with Priority: HIGHEST for action port [ 663.698861] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.699021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.699091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.700898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.700898] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.700898] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.700898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.701193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.701287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.701578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.703095] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.703095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e14a902d-0c13-4946-bdb8-5548cdfca057 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.703095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.703445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.703445] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14a902d-0c13-4946-bdb8-5548cdfca057',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.811192] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 663.811479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.811726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.811954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.812260] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.812458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.812613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.812659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.812709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.812803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.812897] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.084686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2201242c-e887-4d42-96cb-9aa9f289aab8 [ 664.084971] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.085129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.085224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.085412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.085517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.085618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2201242c-e887-4d42-96cb-9aa9f289aab8 already deleted. [ 664.085700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2201242c-e887-4d42-96cb-9aa9f289aab8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.208039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.208039] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.208039] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e14a902d-0c13-4946-bdb8-5548cdfca057 with status ACTIVE [ 664.208039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.208039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.208039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.208943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.208943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.209069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.209116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.210032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.210032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.210032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e14a902d-0c13-4946-bdb8-5548cdfca057 is going to be updated. [ 664.234925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.234925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.234925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.234925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.236046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.236046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e14a902d-0c13-4946-bdb8-5548cdfca057" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.316289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.316461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.316800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.316800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.316923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.316981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.317061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.317203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.317283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.317489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.317710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.317822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.317892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.318072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.318217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.318313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.318377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.318530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.318608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.318690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.318780] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.716200] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.775390] env[65443]: INFO networking_nsxv3.common.synchronization [req-86510b24-c0b3-4116-89e2-70aef5e704f2 req-ded58969-396c-45fc-a2fa-3ef0a7753d4e tempest-ListImageFiltersTestJSON-1965178563 tempest-ListImageFiltersTestJSON-1965178563-project-member] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 664.777389] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 664.779123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.779123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.779123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.779123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.779988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.780148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.780437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.780563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.780701] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.824775] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32d4eeb4-d8a1-4a19-a639-e9bb163080a5: rpc.has_security_group_logging(os_id): False [ 664.848057] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.848057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.848057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.848310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.848310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.850677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.850677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.850677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.851183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.851183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.851183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.851416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.851416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.851416] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be created. [ 664.943117] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.943498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.943681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.943980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.944289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.957172] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 665.170491] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 665.170491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.222108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.222589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.222673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.222880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.222960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.223068] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 is going to be created. [ 665.248543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.248755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.248755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.248949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.249931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.262265] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: UNINITIALIZED for 2s [ 665.285919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.287700] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.287700] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb already deleted. [ 665.287700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.312538] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.312728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.312844] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.313122] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.313483] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.313709] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.313890] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.314326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.314728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.315111] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.316023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 665.316023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 665.316023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 665.316023] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 665.316023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 665.316023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 665.338280] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 665.338455] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 665.338545] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 665.338706] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.339016] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-ab48d740-1059-4c4f-ace7-4220da281175 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.339182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.339309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.339625] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.339789] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab48d740-1059-4c4f-ace7-4220da281175',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.844157] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.844683] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.844826] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.845468] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.845577] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.845765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port ab48d740-1059-4c4f-ace7-4220da281175 not found, creating... [ 665.846301] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.846515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.846739] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.846915] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.847116] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.847461] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.847633] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.847745] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.848026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.848614] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.848614] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: ab48d740-1059-4c4f-ace7-4220da281175 is going to be created. [ 665.877023] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.877023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.877023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.877023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.877023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.877023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.977559] env[65443]: INFO networking_nsxv3.common.synchronization [None req-344fe15d-b75d-48dd-896a-656d6d763c62 None None] Enqueued Resource ID: 2365a075-23ea-4a08-b5c9-639782f3bde6 with Priority: HIGHEST for action port [ 665.978680] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2365a075-23ea-4a08-b5c9-639782f3bde6 with Priority: HIGHEST for action port [ 665.981746] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2365a075-23ea-4a08-b5c9-639782f3bde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.981746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2365a075-23ea-4a08-b5c9-639782f3bde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.981746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2365a075-23ea-4a08-b5c9-639782f3bde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.981746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2365a075-23ea-4a08-b5c9-639782f3bde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.981746] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2365a075-23ea-4a08-b5c9-639782f3bde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.484719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2365a075-23ea-4a08-b5c9-639782f3bde6 [ 666.484977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.485141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.485211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.485425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.485536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.485944] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2365a075-23ea-4a08-b5c9-639782f3bde6 already deleted. [ 666.485944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2365a075-23ea-4a08-b5c9-639782f3bde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.636477] env[65443]: INFO networking_nsxv3.common.synchronization [req-86510b24-c0b3-4116-89e2-70aef5e704f2 req-d71b28df-05d4-4a0c-8eaf-0b98b5360bc2 service nova] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_rules [ 666.636647] env[65443]: INFO networking_nsxv3.common.synchronization [req-86510b24-c0b3-4116-89e2-70aef5e704f2 req-d71b28df-05d4-4a0c-8eaf-0b98b5360bc2 service nova] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 666.637026] env[65443]: INFO networking_nsxv3.common.synchronization [req-86510b24-c0b3-4116-89e2-70aef5e704f2 req-d71b28df-05d4-4a0c-8eaf-0b98b5360bc2 service nova] Enqueued Resource ID: ab48d740-1059-4c4f-ace7-4220da281175 with Priority: HIGHEST for action port [ 666.637368] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_rules [ 666.637500] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 666.637592] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab48d740-1059-4c4f-ace7-4220da281175 with Priority: HIGHEST for action port [ 666.638158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.638291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.638368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.638626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.638729] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.640921] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.640921] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.640921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.640921] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.643758] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab48d740-1059-4c4f-ace7-4220da281175 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.643758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.643758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.643758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.643758] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab48d740-1059-4c4f-ace7-4220da281175',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.809022] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4a7aa703-e757-46a4-b099-fb58b9235eb2 tempest-ServersTestManualDisk-536655571 tempest-ServersTestManualDisk-536655571-project-member] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 666.809958] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 666.810446] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.810446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.810629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.810892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.810961] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.969296] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 666.969616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.144995] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.145170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.145340] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.146347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ab48d740-1059-4c4f-ace7-4220da281175 with status ACTIVE [ 667.146584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.146719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.146719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.148034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.148034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.148034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.149555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ab48d740-1059-4c4f-ace7-4220da281175 is going to be updated. [ 667.177986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.178234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.178310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.178544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.178689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.178944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab48d740-1059-4c4f-ace7-4220da281175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.230927] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b11e0a8b-0cfd-45aa-a123-a3fd4055f67a tempest-ServersTestManualDisk-536655571 tempest-ServersTestManualDisk-536655571-project-member] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 667.231750] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 667.234412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.234412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.272703] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: SUCCESS [ 667.272938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.273136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.273733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.274149] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.274149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.274344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.274344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.274471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.274516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.274601] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.340886] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.341125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.341238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.341865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.341865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.342017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec already deleted. [ 667.343300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.343300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.343300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.343300] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.650628] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.782460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.782460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.782460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.782460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.782460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.783399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.783399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.783399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.787280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.787280] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.869606] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.869936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.869936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.870117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.870209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.870314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec already deleted. [ 667.870416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.154687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.156498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.156592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.156828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.156906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.157049] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be created. [ 668.185234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.185434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.185583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.185841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.185936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.202454] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: UNINITIALIZED for 2s [ 668.288530] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01849c7a-29c1-4280-be13-1fa17a01cb17: rpc.has_security_group_logging(os_id): False [ 668.318373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.318373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.318373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.318373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.319205] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.319205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.319205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.319205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.319205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.319205] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 is going to be created. [ 668.422424] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.422601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.422601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.423365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.423365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.439543] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: IN_PROGRESS for 2s [ 669.487271] env[65443]: INFO networking_nsxv3.common.synchronization [None req-621cf991-9884-4fbd-8c35-582d0b7823b1 None None] Enqueued Resource ID: 44122907-c8a3-434e-92a9-c3a0d6f4b3a3 with Priority: HIGHEST for action port [ 669.487857] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44122907-c8a3-434e-92a9-c3a0d6f4b3a3 with Priority: HIGHEST for action port [ 669.488239] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-44122907-c8a3-434e-92a9-c3a0d6f4b3a3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.488389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44122907-c8a3-434e-92a9-c3a0d6f4b3a3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.488438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44122907-c8a3-434e-92a9-c3a0d6f4b3a3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.490085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44122907-c8a3-434e-92a9-c3a0d6f4b3a3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.490085] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44122907-c8a3-434e-92a9-c3a0d6f4b3a3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.993952] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44122907-c8a3-434e-92a9-c3a0d6f4b3a3 [ 669.994271] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.994527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.994527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.994813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.994943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.995103] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44122907-c8a3-434e-92a9-c3a0d6f4b3a3 already deleted. [ 669.995202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44122907-c8a3-434e-92a9-c3a0d6f4b3a3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.213923] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 670.214208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.214381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.214590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.214781] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.214900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.214954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.215922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.215922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.215922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.215922] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.359024] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e323374-5ba8-4e2f-874f-23c0bece03aa req-57660cad-5f46-4702-9ebf-4d4e1f19935d tempest-FloatingIPsAssociationTestJSON-1022144113 tempest-FloatingIPsAssociationTestJSON-1022144113-project-member] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 670.359024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 670.359024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.359024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.359024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.359024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.359904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.360249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.362274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.362274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.362274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.362274] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.454193] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: SUCCESS [ 670.454421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.697897] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ae23a351-35dc-49be-84e7-fd6c2f4d80ac None None] Enqueued Resource ID: d3609891-4e0f-4cbf-a87b-dc224ee6b290 with Priority: HIGHEST for action port [ 670.697897] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3609891-4e0f-4cbf-a87b-dc224ee6b290 with Priority: HIGHEST for action port [ 670.699125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3609891-4e0f-4cbf-a87b-dc224ee6b290 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.699125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3609891-4e0f-4cbf-a87b-dc224ee6b290" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.699125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3609891-4e0f-4cbf-a87b-dc224ee6b290" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.699125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3609891-4e0f-4cbf-a87b-dc224ee6b290" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.699125] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3609891-4e0f-4cbf-a87b-dc224ee6b290',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.726020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.726020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.726020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.726020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.726020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.726904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.726904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.726904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.726904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.726904] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.866477] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.201256] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3609891-4e0f-4cbf-a87b-dc224ee6b290 [ 671.201595] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.201755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.201826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.202062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.202154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.202254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3609891-4e0f-4cbf-a87b-dc224ee6b290 already deleted. [ 671.202337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3609891-4e0f-4cbf-a87b-dc224ee6b290" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.229446] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23540878-f6a1-4e06-86e4-4e60026efbeb: rpc.has_security_group_logging(os_id): False [ 671.248388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.248566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.248640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.248873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.248988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.249269] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.249397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.249463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.249636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.249716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.249930] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.250037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.250101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.250229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.250299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.250486] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.250595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.250669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.250793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.250855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.251058] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be created. [ 671.313353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.313546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.313611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.313835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.314151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.329309] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 671.368093] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.871784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.872218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.872218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.872618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.872806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.872908] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be updated. [ 671.910450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.910450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.911323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.911323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.911323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.923876] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 672.571384] env[65443]: INFO networking_nsxv3.common.synchronization [req-8d451af9-ef14-4316-afd8-33b6cc20b087 req-2e53fc17-0b86-4e3d-9f86-ead174065205 tempest-ServersTestFqdnHostnames-1972796060 tempest-ServersTestFqdnHostnames-1972796060-project-member] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 672.572852] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 672.574099] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.574260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.574335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.575018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.575314] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.575399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.575470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.575696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.577315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.577453] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.022286] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-962 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.022730] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-962" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.022730] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-962" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.024190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-962" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.024190] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.024190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.024190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.024190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.024496] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.024496] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.024610] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 673.024736] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 673.024878] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 673.025067] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 673.025214] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 673.025355] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 673.053142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 673.053260] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 673.053339] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 673.053518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-962" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.053892] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-4e979e2d-9f14-48ab-a4b9-e3426573e11c taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.054102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.054191] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.054550] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.054702] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e979e2d-9f14-48ab-a4b9-e3426573e11c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.082489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.082489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.082489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.082489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.082489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.082987] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.082987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.083137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.083307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.083533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.083674] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 already deleted. [ 673.083823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.358469] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 673.359337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.558133] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.561037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 4e979e2d-9f14-48ab-a4b9-e3426573e11c not found, creating... [ 673.561037] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.561037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.561855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.565515] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.565515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.565515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.565515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.565515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.565515] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 4e979e2d-9f14-48ab-a4b9-e3426573e11c is going to be created. [ 673.591037] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.591037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.591037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.591037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.591037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.591037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.936636] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 673.936895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [req-8d451af9-ef14-4316-afd8-33b6cc20b087 req-5fe3afcc-56c1-432d-962f-fcd0343934d1 service nova] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [req-8d451af9-ef14-4316-afd8-33b6cc20b087 req-5fe3afcc-56c1-432d-962f-fcd0343934d1 service nova] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [req-8d451af9-ef14-4316-afd8-33b6cc20b087 req-5fe3afcc-56c1-432d-962f-fcd0343934d1 service nova] Enqueued Resource ID: 4e979e2d-9f14-48ab-a4b9-e3426573e11c with Priority: HIGHEST for action port [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_rules [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 674.424303] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e979e2d-9f14-48ab-a4b9-e3426573e11c with Priority: HIGHEST for action port [ 674.424805] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.424805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.424805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.424933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.425025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.426265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.426602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.426602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.426602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.427379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.427379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.427379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.427517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.427574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.427663] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.428473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e979e2d-9f14-48ab-a4b9-e3426573e11c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.428579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.429067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.429067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.429067] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e979e2d-9f14-48ab-a4b9-e3426573e11c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.933037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.933037] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.933037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e979e2d-9f14-48ab-a4b9-e3426573e11c with status ACTIVE [ 674.933037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.933037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.933037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.933851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.933851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.933851] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.933971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.934110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.934976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.935116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.935238] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e979e2d-9f14-48ab-a4b9-e3426573e11c is going to be updated. [ 674.960934] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.961096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.961163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.961503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.961855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.962054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e979e2d-9f14-48ab-a4b9-e3426573e11c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.439200] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.562298] env[65443]: INFO networking_nsxv3.common.synchronization [None req-60babfbe-9c19-40c2-9bfb-8d924d4ac969 None None] Enqueued Resource ID: 1fbfae3a-0838-4ef1-9558-36ee480c7ec6 with Priority: HIGHEST for action port [ 675.564020] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fbfae3a-0838-4ef1-9558-36ee480c7ec6 with Priority: HIGHEST for action port [ 675.564020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fbfae3a-0838-4ef1-9558-36ee480c7ec6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.564020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fbfae3a-0838-4ef1-9558-36ee480c7ec6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.564020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fbfae3a-0838-4ef1-9558-36ee480c7ec6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.564020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fbfae3a-0838-4ef1-9558-36ee480c7ec6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.564508] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fbfae3a-0838-4ef1-9558-36ee480c7ec6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.944795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.944795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.944795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.945020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.945268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.945268] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 is going to be created. [ 675.974349] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.974507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.974572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.974804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.974966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.983565] env[65443]: INFO networking_nsxv3.common.synchronization [None req-43028a8d-c421-411f-acc6-714c688ace78 None None] Enqueued Resource ID: 03ed9659-7cae-4a20-ab46-e6e60b9610a8 with Priority: HIGHEST for action port [ 675.984118] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03ed9659-7cae-4a20-ab46-e6e60b9610a8 with Priority: HIGHEST for action port [ 675.984498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-03ed9659-7cae-4a20-ab46-e6e60b9610a8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.984634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03ed9659-7cae-4a20-ab46-e6e60b9610a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.984705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03ed9659-7cae-4a20-ab46-e6e60b9610a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.984977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03ed9659-7cae-4a20-ab46-e6e60b9610a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.985082] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03ed9659-7cae-4a20-ab46-e6e60b9610a8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.987466] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: UNINITIALIZED for 2s [ 676.066960] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fbfae3a-0838-4ef1-9558-36ee480c7ec6 [ 676.069396] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.069586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.069656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.070311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.070311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.070311] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fbfae3a-0838-4ef1-9558-36ee480c7ec6 already deleted. [ 676.070311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fbfae3a-0838-4ef1-9558-36ee480c7ec6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.489222] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03ed9659-7cae-4a20-ab46-e6e60b9610a8 [ 676.489222] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.489222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.489222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.489222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.489222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.489222] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03ed9659-7cae-4a20-ab46-e6e60b9610a8 already deleted. [ 676.489222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03ed9659-7cae-4a20-ab46-e6e60b9610a8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.349288] env[65443]: INFO networking_nsxv3.common.synchronization [None req-194afdb6-b49e-4411-a2ee-efbea089da16 None None] Enqueued Resource ID: a7773af2-4f61-40a5-a685-c826c92eb7d1 with Priority: HIGHEST for action port [ 677.350024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7773af2-4f61-40a5-a685-c826c92eb7d1 with Priority: HIGHEST for action port [ 677.350024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7773af2-4f61-40a5-a685-c826c92eb7d1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.350809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7773af2-4f61-40a5-a685-c826c92eb7d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.350809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7773af2-4f61-40a5-a685-c826c92eb7d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.350809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7773af2-4f61-40a5-a685-c826c92eb7d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.350809] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7773af2-4f61-40a5-a685-c826c92eb7d1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.855976] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7773af2-4f61-40a5-a685-c826c92eb7d1 [ 677.857035] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.857035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.857035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.857035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.857035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.857373] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7773af2-4f61-40a5-a685-c826c92eb7d1 already deleted. [ 677.857373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7773af2-4f61-40a5-a685-c826c92eb7d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.951706] env[65443]: INFO networking_nsxv3.common.synchronization [req-8e2c12fb-0ad2-4eb9-9d2c-1a79214d2a56 req-69a7c57d-63a1-4a99-817e-174895333aee tempest-ListImageFiltersTestJSON-1965178563 tempest-ListImageFiltersTestJSON-1965178563-project-member] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 677.952141] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 677.953603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.953603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.953603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.953603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.956398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.956690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.956690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.956954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.957059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.957161] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.001335] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: SUCCESS [ 678.001335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.004341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.004341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.004341] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.459927] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.491531] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.492989] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.493204] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.493543] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.494452] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.494452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.494452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.494452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.494800] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.494800] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.495017] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.495017] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.495100] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.495202] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.495343] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.495427] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.506680] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.524765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.526418] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.526418] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.526418] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.526418] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-dc21dc55-1199-4830-82fb-214f671108a9 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.526418] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.527802] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.527802] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.527802] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc21dc55-1199-4830-82fb-214f671108a9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.967109] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.012296] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b8c4c8d-3b25-4427-a750-99a3dcc5e324: rpc.has_security_group_logging(os_id): False [ 679.034033] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.034033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.034033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.034033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.034033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.034033] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port dc21dc55-1199-4830-82fb-214f671108a9 not found, creating... [ 679.034033] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.034033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.035156] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.035794] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.036248] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.036934] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.037925] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.039231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.039231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.039231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.039360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: dc21dc55-1199-4830-82fb-214f671108a9 is going to be created. [ 679.042295] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.042555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.042749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.043093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.043304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.043723] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.043952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.044152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.044481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.044642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.044837] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 is going to be created. [ 679.073219] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.074913] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.074913] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.075268] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.076246] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.076611] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.154139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.154319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.154497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.154702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.155519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.179103] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: IN_PROGRESS for 2s [ 679.470124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.470283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.470354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.470578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.470668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.470766] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be updated. [ 679.513803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.514036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.514167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.514481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.514576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.529817] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 679.849373] env[65443]: INFO networking_nsxv3.common.synchronization [req-8e2c12fb-0ad2-4eb9-9d2c-1a79214d2a56 req-6819f349-963c-4677-85f4-c5c3aa7cb557 service nova] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_rules [ 679.849373] env[65443]: INFO networking_nsxv3.common.synchronization [req-8e2c12fb-0ad2-4eb9-9d2c-1a79214d2a56 req-6819f349-963c-4677-85f4-c5c3aa7cb557 service nova] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 679.849794] env[65443]: INFO networking_nsxv3.common.synchronization [req-8e2c12fb-0ad2-4eb9-9d2c-1a79214d2a56 req-6819f349-963c-4677-85f4-c5c3aa7cb557 service nova] Enqueued Resource ID: dc21dc55-1199-4830-82fb-214f671108a9 with Priority: HIGHEST for action port [ 679.850168] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_rules [ 679.850319] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 679.850416] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc21dc55-1199-4830-82fb-214f671108a9 with Priority: HIGHEST for action port [ 679.850707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.850890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.850890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.851189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.851189] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.852780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.852922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.853500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc21dc55-1199-4830-82fb-214f671108a9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.853721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.854581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.854581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.854581] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc21dc55-1199-4830-82fb-214f671108a9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.096941] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4955679a-81aa-49d4-8e16-964b4422e42f None None] Enqueued Resource ID: 5c871dc4-1041-407e-aac3-13efbfd54658 with Priority: HIGHEST for action port [ 680.100275] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c871dc4-1041-407e-aac3-13efbfd54658 with Priority: HIGHEST for action port [ 680.100275] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c871dc4-1041-407e-aac3-13efbfd54658 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.100275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c871dc4-1041-407e-aac3-13efbfd54658" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.100275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c871dc4-1041-407e-aac3-13efbfd54658" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.100275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c871dc4-1041-407e-aac3-13efbfd54658" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.100275] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c871dc4-1041-407e-aac3-13efbfd54658',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.359023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc21dc55-1199-4830-82fb-214f671108a9 with status ACTIVE [ 680.359023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.359023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.359023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.359023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.359679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.359679] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.359679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.359679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.359679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.359679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.360170] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.360170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.360170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.360170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.360337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.360337] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc21dc55-1199-4830-82fb-214f671108a9 is going to be updated. [ 680.361950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.361950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.390838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.391055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.391055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.391262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.391412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.391672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc21dc55-1199-4830-82fb-214f671108a9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.450265] env[65443]: INFO networking_nsxv3.common.synchronization [req-e39eaa5d-3df6-4ee3-b475-6ceb2c4e13b9 req-0a105940-adcb-4d65-9c63-8836b167899f tempest-DeleteServersAdminTestJSON-386804794 tempest-DeleteServersAdminTestJSON-386804794-project-member] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 680.451055] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGHEST for action security_group_members [ 680.451869] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.451869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.451869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.451869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.451869] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.452311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.452391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.452596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.452689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.452787] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.603664] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c871dc4-1041-407e-aac3-13efbfd54658 [ 680.605235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.605235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.605235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.605235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.606552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.606552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c871dc4-1041-407e-aac3-13efbfd54658 already deleted. [ 680.606552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c871dc4-1041-407e-aac3-13efbfd54658" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.723316] env[65443]: INFO networking_nsxv3.common.synchronization [req-26f17e44-af29-431a-9082-703be643c7a3 req-73bfd36a-e96f-4665-848a-9e80377fd207 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 680.723316] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 680.723316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.723316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.723316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.723316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.723316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.725724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.725724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.725724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.725724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.725724] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.955185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.955336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.955450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.955768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.955768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.956035] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.956035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.956035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.956192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.956278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.958062] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be updated. [ 680.990587] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.990833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.990937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.992328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.992328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.004056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: IN_PROGRESS for 2s [ 681.053833] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.053833] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.053833] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.053833] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.053833] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.054342] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.054385] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.055060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.055060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.055854] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.055854] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.055854] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.056064] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.056064] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.056338] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.056757] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.078502] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.078804] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.078913] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.079222] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.079669] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.080719] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.080992] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.083847] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.084132] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.193167] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: SUCCESS [ 681.193167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.229532] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.541273] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 681.541505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.541945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.542034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.542224] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.542345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.542443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.542625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.542747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.542886] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.587107] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.587388] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.587525] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.587860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.588031] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.588184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 not found, creating... [ 681.588456] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.588669] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.588870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.589233] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.589486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.589916] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.590095] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.590250] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.590456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.590577] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.590712] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 is going to be created. [ 681.616184] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.616184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.616184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.616184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.616184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.616184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.732962] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.044993] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.235431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.235812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.235812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.235893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.235933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.236056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be updated. [ 682.299063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.299210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.299283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.299511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.299712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.311760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 682.404873] env[65443]: INFO networking_nsxv3.common.synchronization [req-26f17e44-af29-431a-9082-703be643c7a3 req-2e1f4e8a-041d-44a2-9353-7acaaab59b58 service nova] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_rules [ 682.404873] env[65443]: INFO networking_nsxv3.common.synchronization [req-26f17e44-af29-431a-9082-703be643c7a3 req-2e1f4e8a-041d-44a2-9353-7acaaab59b58 service nova] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 682.404873] env[65443]: INFO networking_nsxv3.common.synchronization [req-26f17e44-af29-431a-9082-703be643c7a3 req-2e1f4e8a-041d-44a2-9353-7acaaab59b58 service nova] Enqueued Resource ID: bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 with Priority: HIGHEST for action port [ 682.405228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_rules [ 682.405366] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 682.405466] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 with Priority: HIGHEST for action port [ 682.406177] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.406177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.406177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.406606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.406606] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.407926] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.407926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.408088] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.408193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.408895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.408895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.408895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.551895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.911375] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 with status ACTIVE [ 682.912070] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.912070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.912773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.912773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.912773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.912773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.912974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.912974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.913178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.913369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.914181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.914928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.914928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.914928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.914928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.914928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8 is going to be updated. [ 682.915996] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.916118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.939386] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.939386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.939386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.939386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.939386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.939386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb83c5a0-5fdb-4ab3-8f0f-001e89be75f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.015166] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb in Status: SUCCESS [ 683.015626] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb deletion is rescheduled due to dependency. [ 683.015775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.054625] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.055226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.055226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.055226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.055361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.055422] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be updated. [ 683.131185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.131185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.131185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.131589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.131822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.143109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 683.624907] env[65443]: INFO networking_nsxv3.common.synchronization [req-1b53acb9-4652-4b6c-8bf0-dd9da3974680 req-4b4e9117-45ab-4fdc-bd89-6bb6f421f080 tempest-VolumesAdminNegativeTest-1869350700 tempest-VolumesAdminNegativeTest-1869350700-project-member] Enqueued Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 683.625834] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 683.626905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.627089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.627163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.627458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.627638] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.627758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.627824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.628049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.628108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.628218] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.131108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.131257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.131257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.131475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.131641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.131879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.131974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.132055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.132242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.132326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.132411] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d already deleted. [ 684.132521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.324028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 684.324490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.324745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.325090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.325377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.325848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.325848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.326528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.326528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.326528] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.421878] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-565 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.421878] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-565" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.421878] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-565" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.421878] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-565" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.421878] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.422216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.422216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.422357] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.422551] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.422744] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.423060] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.423060] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.423060] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.423197] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.423280] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.423427] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.452669] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.452781] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.453422] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.453422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-565" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.453709] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-c6cbd502-2609-4662-85dc-0268fc757670 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.453709] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.453877] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.454290] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.454357] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6cbd502-2609-4662-85dc-0268fc757670',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.830241] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.957046] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.957311] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.957440] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.957763] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.957946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.958142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port c6cbd502-2609-4662-85dc-0268fc757670 not found, creating... [ 684.958470] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.958607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.958734] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.958999] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.959182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.959549] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.959703] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.959844] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.960104] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.960261] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.960415] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: c6cbd502-2609-4662-85dc-0268fc757670 is going to be created. [ 684.982780] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.983068] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.983199] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.983508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.983897] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.984270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.154766] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 685.155120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.155206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.155395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.155589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.155716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.155865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.156111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.156215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.156328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.156655] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.333414] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.505160] env[65443]: INFO networking_nsxv3.common.synchronization [req-82a2f30b-ed77-44db-9301-a1b77dada67c req-c8d39150-697e-4763-8e84-316c321b0ac5 tempest-ServerAddressesTestJSON-297973440 tempest-ServerAddressesTestJSON-297973440-project-member] Enqueued Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 685.505748] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGHEST for action security_group_members [ 685.506765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.506917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.506992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.507215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.507376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.507482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.507572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.507694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.508046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.508157] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.659264] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.659445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.659473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.659720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.659954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.660081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.660081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.660255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.660343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.660535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.660613] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.660701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.660754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.660895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.661041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.661168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.661219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.661309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.661379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.661464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.661596] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.734923] env[65443]: INFO networking_nsxv3.common.synchronization [req-1b53acb9-4652-4b6c-8bf0-dd9da3974680 req-a51324e0-1b89-4215-884a-c6387446b55f service nova] Enqueued Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_rules [ 685.735361] env[65443]: INFO networking_nsxv3.common.synchronization [req-1b53acb9-4652-4b6c-8bf0-dd9da3974680 req-a51324e0-1b89-4215-884a-c6387446b55f service nova] Enqueued Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 685.735444] env[65443]: INFO networking_nsxv3.common.synchronization [req-1b53acb9-4652-4b6c-8bf0-dd9da3974680 req-a51324e0-1b89-4215-884a-c6387446b55f service nova] Enqueued Resource ID: c6cbd502-2609-4662-85dc-0268fc757670 with Priority: HIGHEST for action port [ 685.736142] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_rules [ 685.736528] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 685.736528] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6cbd502-2609-4662-85dc-0268fc757670 with Priority: HIGHEST for action port [ 685.736634] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.736743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.736804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.737301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.737301] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.738710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.738710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.738837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.738952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.739134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.739281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.739328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.739562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.739698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.739826] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.741707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6cbd502-2609-4662-85dc-0268fc757670 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.741823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.741880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.742080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.742154] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6cbd502-2609-4662-85dc-0268fc757670',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.837509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.837778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.837778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.837904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.837989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.838258] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be updated. [ 685.875526] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.875688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.876371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.876371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.876371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.886467] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 686.011409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.011740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.011879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.012247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.012410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.012741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.012897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.012994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.013263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.013393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.013525] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 is going to be updated. [ 686.050770] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.050770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.050770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.050918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.050946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.062825] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: IN_PROGRESS for 2s [ 686.164626] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23540878-f6a1-4e06-86e4-4e60026efbeb: rpc.has_security_group_logging(os_id): False [ 686.185950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.186178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.186221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.186436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.186545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.186777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.186892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.186952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.187150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.187242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.187468] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.187584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.187657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.187839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.187923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.188164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.188275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.188347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.188889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.188889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.188889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be updated. [ 686.253023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.253023] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.253023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6cbd502-2609-4662-85dc-0268fc757670 with status ACTIVE [ 686.253023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.253023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.253023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.253709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.253878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.254175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.254394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.254538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.254766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.254937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.255171] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6cbd502-2609-4662-85dc-0268fc757670 is going to be updated. [ 686.271408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.271662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.271662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.271910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.272118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.334518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 686.373982] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.374272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.374348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.374598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.374755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.374936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6cbd502-2609-4662-85dc-0268fc757670" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.758644] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.926225] env[65443]: INFO networking_nsxv3.common.synchronization [req-c5d6c739-e16e-4335-b3df-157f89420a49 req-0b88d8ad-1251-4870-9fdb-3dada107f43b tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 686.926792] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 686.927090] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.927213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.927273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.927490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.928343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.928520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.928584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.928803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.928929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.929068] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.260834] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.261148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.261148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.261339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.261479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.261635] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d is going to be created. [ 687.301227] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.301370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.301442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.303455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.303455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.325763] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: UNINITIALIZED for 2s [ 687.431785] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.432068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.432068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.432251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.432481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.432544] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.432647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.432713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.432937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.432937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.433038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 687.465681] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.466709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.466709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.466709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.466709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.475454] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 687.563473] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7c11bb6c-5e2a-44aa-b601-2efeb9edd31a None None] Enqueued Resource ID: 7e6811ca-ad97-4c68-83c4-9254575e001c with Priority: HIGHEST for action port [ 687.564342] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e6811ca-ad97-4c68-83c4-9254575e001c with Priority: HIGHEST for action port [ 687.564675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e6811ca-ad97-4c68-83c4-9254575e001c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.564791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e6811ca-ad97-4c68-83c4-9254575e001c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.564832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e6811ca-ad97-4c68-83c4-9254575e001c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.565269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e6811ca-ad97-4c68-83c4-9254575e001c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.565269] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e6811ca-ad97-4c68-83c4-9254575e001c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.897882] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 687.898367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.898642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.899554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.899857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.900123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.900272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.900541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.900712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.900878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.901454] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.954319] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9482571-f5c7-4fad-a149-376bc07ef20f req-93109c0f-befa-4990-b008-7080b2f23483 tempest-ServersAdminNegativeTestJSON-1088238682 tempest-ServersAdminNegativeTestJSON-1088238682-project-member] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 687.954319] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 687.955047] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.955332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.955483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.955803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.957877] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.957877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.957877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.957877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.957877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.957877] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.073021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e6811ca-ad97-4c68-83c4-9254575e001c [ 688.073021] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.073021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.073021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.073021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.073021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.073021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e6811ca-ad97-4c68-83c4-9254575e001c already deleted. [ 688.073021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e6811ca-ad97-4c68-83c4-9254575e001c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.074690] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 in Status: SUCCESS [ 688.074877] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 deletion is rescheduled due to dependency. [ 688.074998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.360837] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 688.361785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.404658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.404912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.405103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.405338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.405537] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.405749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.405749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.405861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.405941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.406045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.406190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.406305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.406305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.406527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.406609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.406694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.406753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.407075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.407075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.407075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.407191] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.460409] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.912070] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32d4eeb4-d8a1-4a19-a639-e9bb163080a5: rpc.has_security_group_logging(os_id): False [ 688.934217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.934413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.934464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.934663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.934761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.934951] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.935068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.935133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.935282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.935360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.935544] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.935906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.935906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.935906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.935906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.936111] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.936207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.936269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.936408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.936484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.936569] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be updated. [ 688.963704] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.022383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.022383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.022383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.022383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.022383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.040226] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 689.338733] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: SUCCESS [ 689.338733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.338733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.339158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.339158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.339158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.339295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.339389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.339471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.339578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.339642] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.389392] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a5330fe9-ae75-4c94-9bd2-ba75c7677f6a None None] Enqueued Resource ID: 2b95c4fc-f050-4a25-ba43-2758eb45170c with Priority: HIGHEST for action port [ 689.389392] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b95c4fc-f050-4a25-ba43-2758eb45170c with Priority: HIGHEST for action port [ 689.390265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b95c4fc-f050-4a25-ba43-2758eb45170c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.390578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b95c4fc-f050-4a25-ba43-2758eb45170c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.390678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b95c4fc-f050-4a25-ba43-2758eb45170c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.390971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b95c4fc-f050-4a25-ba43-2758eb45170c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.391202] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b95c4fc-f050-4a25-ba43-2758eb45170c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.466695] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.468539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.468539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.468539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.468539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.468539] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be updated. [ 689.485571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 689.485694] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e deletion is rescheduled due to dependency. [ 689.485811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.506475] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.506619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.506680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.506933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.506973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.517503] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 689.606013] env[65443]: INFO networking_nsxv3.common.synchronization [req-8b33bc4c-f3a7-49a6-8e7a-ad4fedfa95b4 req-2269356b-929d-4bb2-8293-d955ad0fbe06 tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 689.606013] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 689.606013] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.606013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.606682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.607365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.607637] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.607834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.607978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.608750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.609012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.609223] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.841838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.842051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.842935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.842935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.842935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.842935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.842935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.843135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.843135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.843185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.843340] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.843430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.844710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.844710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.844710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.844710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.844710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.846535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.846708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.846856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.846979] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.894233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2b95c4fc-f050-4a25-ba43-2758eb45170c [ 689.894429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.894612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.894612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.894860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.895301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.895301] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2b95c4fc-f050-4a25-ba43-2758eb45170c already deleted. [ 689.895301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b95c4fc-f050-4a25-ba43-2758eb45170c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.115457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.115457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.115457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.115939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.115939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.115939] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 already deleted. [ 690.115939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.166197] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e49f7483-a159-4bf9-9cea-927bb2b3b98a None None] Enqueued Resource ID: 3d02261a-fcae-48fa-8c17-8c48229dba55 with Priority: HIGHEST for action port [ 690.166197] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d02261a-fcae-48fa-8c17-8c48229dba55 with Priority: HIGHEST for action port [ 690.166197] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d02261a-fcae-48fa-8c17-8c48229dba55 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.166197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d02261a-fcae-48fa-8c17-8c48229dba55" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.166197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d02261a-fcae-48fa-8c17-8c48229dba55" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.166696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d02261a-fcae-48fa-8c17-8c48229dba55" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.168330] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d02261a-fcae-48fa-8c17-8c48229dba55',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.234035] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.234204] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.234256] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.234636] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.235217] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.235217] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.235217] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.235430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.235569] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.235769] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.235875] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.235977] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.236088] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.236188] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.236283] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.236430] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.258225] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.258781] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.258781] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.258781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.259106] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.259288] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.259403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.259864] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.259930] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704e8bb7-b6b6-4818-bbb4-11b239c9a1de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.353963] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb18cd6e-092e-4f1e-972b-3476700e4c4d: rpc.has_security_group_logging(os_id): False [ 690.373405] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.373555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.373604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.373815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.373925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.374142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.374244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.374309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.374456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.374537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.375935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.375935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.375935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.375935] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d is going to be created. [ 690.456750] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.456750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.456750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.456750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.456750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.469506] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: IN_PROGRESS for 2s [ 690.671038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d02261a-fcae-48fa-8c17-8c48229dba55 [ 690.671038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.671038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.671038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.671038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.671038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.671038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d02261a-fcae-48fa-8c17-8c48229dba55 already deleted. [ 690.671038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d02261a-fcae-48fa-8c17-8c48229dba55" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.762388] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.762607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.762763] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.763050] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.767087] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 704e8bb7-b6b6-4818-bbb4-11b239c9a1de not found, creating... [ 690.767087] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.767087] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.767087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.768359] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.768359] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.768359] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 704e8bb7-b6b6-4818-bbb4-11b239c9a1de is going to be created. [ 690.792302] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.792670] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.792860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.793213] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.793540] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.793907] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.056493] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 691.056870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.142469] env[65443]: INFO networking_nsxv3.common.synchronization [None req-9924e6ae-58e8-4946-b140-527766b582e7 None None] Enqueued Resource ID: bdfdd43a-8aca-430e-a412-e8bb25294fc2 with Priority: HIGHEST for action port [ 691.144189] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdfdd43a-8aca-430e-a412-e8bb25294fc2 with Priority: HIGHEST for action port [ 691.144879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdfdd43a-8aca-430e-a412-e8bb25294fc2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.145558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdfdd43a-8aca-430e-a412-e8bb25294fc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.147430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdfdd43a-8aca-430e-a412-e8bb25294fc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.147430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdfdd43a-8aca-430e-a412-e8bb25294fc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.147430] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdfdd43a-8aca-430e-a412-e8bb25294fc2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.528123] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 691.528271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.570333] env[65443]: INFO networking_nsxv3.common.synchronization [req-8b33bc4c-f3a7-49a6-8e7a-ad4fedfa95b4 req-0508bfd6-2805-4a59-a5ca-28a9b1b070c8 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 691.570497] env[65443]: INFO networking_nsxv3.common.synchronization [req-8b33bc4c-f3a7-49a6-8e7a-ad4fedfa95b4 req-0508bfd6-2805-4a59-a5ca-28a9b1b070c8 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 691.570626] env[65443]: INFO networking_nsxv3.common.synchronization [req-8b33bc4c-f3a7-49a6-8e7a-ad4fedfa95b4 req-0508bfd6-2805-4a59-a5ca-28a9b1b070c8 service nova] Enqueued Resource ID: 704e8bb7-b6b6-4818-bbb4-11b239c9a1de with Priority: HIGHEST for action port [ 691.571230] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 691.575025] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 691.575025] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e8bb7-b6b6-4818-bbb4-11b239c9a1de with Priority: HIGHEST for action port [ 691.575025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.575025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.575025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.575025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.575025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.576103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.576103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.576103] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.576103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.576667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.576667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.576667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.576667] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('704e8bb7-b6b6-4818-bbb4-11b239c9a1de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.649964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdfdd43a-8aca-430e-a412-e8bb25294fc2 [ 691.649964] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.649964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.649964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.649964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.649964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.649964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdfdd43a-8aca-430e-a412-e8bb25294fc2 already deleted. [ 691.649964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdfdd43a-8aca-430e-a412-e8bb25294fc2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.864829] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4c69a05a-2678-4c4b-9eb1-cb8b55980a36 None None] Enqueued Resource ID: fca6119e-4547-421e-80d2-8b474223068c with Priority: HIGHEST for action port [ 691.865901] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fca6119e-4547-421e-80d2-8b474223068c with Priority: HIGHEST for action port [ 691.866724] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-fca6119e-4547-421e-80d2-8b474223068c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.866912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fca6119e-4547-421e-80d2-8b474223068c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.866912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fca6119e-4547-421e-80d2-8b474223068c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.867280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fca6119e-4547-421e-80d2-8b474223068c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.867280] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fca6119e-4547-421e-80d2-8b474223068c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.079681] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.079906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.080115] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 704e8bb7-b6b6-4818-bbb4-11b239c9a1de with status ACTIVE [ 692.080231] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.080446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.080446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.080619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.080708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.080922] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.080995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.081053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.081192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.081269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.081577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.081727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.081795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.081945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.082045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.082116] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 704e8bb7-b6b6-4818-bbb4-11b239c9a1de is going to be updated. [ 692.085045] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.128054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.128693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.128693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.128693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.128693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.129200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-704e8bb7-b6b6-4818-bbb4-11b239c9a1de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.369909] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fca6119e-4547-421e-80d2-8b474223068c [ 692.370257] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.370873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.370873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.370873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.370873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.370873] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fca6119e-4547-421e-80d2-8b474223068c already deleted. [ 692.371168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fca6119e-4547-421e-80d2-8b474223068c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.422482] env[65443]: INFO networking_nsxv3.common.synchronization [req-19a91b29-a52d-4bbe-9870-a6b3d0ff68ed req-dbccb3aa-e06b-4d29-8ec6-7c9233a3d5a6 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 692.422482] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 692.422482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.422482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.422720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.422784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.422939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.423308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.423398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.423563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.423655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.423753] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.482723] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: SUCCESS [ 692.483050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.595215] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.902924] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.903313] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.905060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.905060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.905328] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.905499] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.905656] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.905833] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.905994] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.906196] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.906299] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.906398] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.906497] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.906596] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.906688] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.907184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.927966] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.928127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.928262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.928507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.928634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.928868] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.929016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.929186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.929399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.929568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.929568] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 already deleted. [ 692.929692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.930673] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.930821] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.930985] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.931121] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.931404] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-21e08cf6-f018-4e17-81af-9ecaca9b77dd taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.931748] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.931818] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.932062] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.935575] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e08cf6-f018-4e17-81af-9ecaca9b77dd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.096116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.096287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.096580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.097371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.097371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.097371] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be created. [ 693.122665] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.122845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.122954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.123554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.123554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.136148] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: UNINITIALIZED for 2s [ 693.441043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.441043] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 21e08cf6-f018-4e17-81af-9ecaca9b77dd not found, creating... [ 693.441043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.441043] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.441675] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.441675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.441675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.441675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.441675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.441675] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd is going to be created. [ 693.466772] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.467022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.467119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.467486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.468318] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.468318] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.617870] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0f0ff83c-c004-4f57-bfc5-743ccb2adb3d None None] Enqueued Resource ID: abc0be74-fdf7-44b5-9f1c-4b42cb018a48 with Priority: HIGHEST for action port [ 693.618753] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abc0be74-fdf7-44b5-9f1c-4b42cb018a48 with Priority: HIGHEST for action port [ 693.623324] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-abc0be74-fdf7-44b5-9f1c-4b42cb018a48 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.623413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abc0be74-fdf7-44b5-9f1c-4b42cb018a48" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.623444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abc0be74-fdf7-44b5-9f1c-4b42cb018a48" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.623863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abc0be74-fdf7-44b5-9f1c-4b42cb018a48" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.623863] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abc0be74-fdf7-44b5-9f1c-4b42cb018a48',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.126755] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abc0be74-fdf7-44b5-9f1c-4b42cb018a48 [ 694.127397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.127588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.127688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.127970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.128118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.128246] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abc0be74-fdf7-44b5-9f1c-4b42cb018a48 already deleted. [ 694.128358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abc0be74-fdf7-44b5-9f1c-4b42cb018a48" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.225247] env[65443]: INFO networking_nsxv3.common.synchronization [req-19a91b29-a52d-4bbe-9870-a6b3d0ff68ed req-14d4d4f0-0579-432d-8829-0347feb74870 service nova] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 694.225247] env[65443]: INFO networking_nsxv3.common.synchronization [req-19a91b29-a52d-4bbe-9870-a6b3d0ff68ed req-14d4d4f0-0579-432d-8829-0347feb74870 service nova] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 694.225247] env[65443]: INFO networking_nsxv3.common.synchronization [req-19a91b29-a52d-4bbe-9870-a6b3d0ff68ed req-14d4d4f0-0579-432d-8829-0347feb74870 service nova] Enqueued Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 694.225780] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 694.225928] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 694.226881] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 694.226881] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.226881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.226881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.227462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.227462] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.230802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.230802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.230802] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.230802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e08cf6-f018-4e17-81af-9ecaca9b77dd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.230802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.230802] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e08cf6-f018-4e17-81af-9ecaca9b77dd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.383952] env[65443]: INFO networking_nsxv3.common.synchronization [None req-76fea842-2fe4-4566-93bb-c42d55b4f084 None None] Enqueued Resource ID: 9a17459c-96ac-4250-aecb-1fa213633a3f with Priority: HIGHEST for action port [ 694.384605] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a17459c-96ac-4250-aecb-1fa213633a3f with Priority: HIGHEST for action port [ 694.384916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a17459c-96ac-4250-aecb-1fa213633a3f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.387731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a17459c-96ac-4250-aecb-1fa213633a3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.387731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a17459c-96ac-4250-aecb-1fa213633a3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.387731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a17459c-96ac-4250-aecb-1fa213633a3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.387731] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a17459c-96ac-4250-aecb-1fa213633a3f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.732618] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.733246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.733246] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.734454] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e08cf6-f018-4e17-81af-9ecaca9b77dd with status ACTIVE [ 694.736138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.736284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.736367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.736571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.736667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.736860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.736953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.738096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.738391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.738566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.738713] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.738932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.738932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.739073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.739157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.739285] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd is going to be updated. [ 694.768026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.768206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.768309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.768552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.768687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.768878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.888945] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a17459c-96ac-4250-aecb-1fa213633a3f [ 694.889213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.889348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.889412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.889633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.889746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.889810] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a17459c-96ac-4250-aecb-1fa213633a3f already deleted. [ 694.889890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a17459c-96ac-4250-aecb-1fa213633a3f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.930666] env[65443]: INFO networking_nsxv3.common.synchronization [req-cfcbb16b-5ed3-4bfd-a4eb-7a86e4d4915a req-66e7dac1-8b55-4d3a-bb51-4e8f98447762 tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 694.931424] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 694.932165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.932274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.150220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 695.150455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.150659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.150937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.151171] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.151322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.151407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.151604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.151996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.151996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.151996] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.152920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.153610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.153610] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.153610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.153610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.153610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.153610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.153949] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.243749] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.430183] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.430363] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.430649] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.431392] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.433153] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.433348] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.433465] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.433695] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.433838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.434115] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.434231] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 695.434331] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 695.434430] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 695.434535] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 695.434632] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 695.434754] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 695.459522] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 695.459522] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 695.459522] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 695.459522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.459522] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-e14ac33d-a9e4-41db-8a22-413315718f51 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.459522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.459522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.459522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.460099] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14ac33d-a9e4-41db-8a22-413315718f51',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.656546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.656802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.657020] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.746176] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.746456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.746456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.746596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.746692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.746824] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be created. [ 695.772133] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.772282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.772354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.772636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.772865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.783889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: UNINITIALIZED for 2s [ 695.963156] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.963405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.963567] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.963804] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.964164] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.964164] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port e14ac33d-a9e4-41db-8a22-413315718f51 not found, creating... [ 695.965025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.965025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.965025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.965025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.965025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.965271] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.965765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.965765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.965765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.965765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.965898] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: e14ac33d-a9e4-41db-8a22-413315718f51 is going to be created. [ 695.989472] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.989830] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.989917] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.990711] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.990953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.991214] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.159584] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.663030] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.663273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.663388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.663636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.663734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.663831] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 696.700351] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.700529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.700566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.700780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.700928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.712325] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 696.820023] env[65443]: INFO networking_nsxv3.common.synchronization [req-cfcbb16b-5ed3-4bfd-a4eb-7a86e4d4915a req-efc90c7d-f2d5-4686-b287-b5268bfaeeb6 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 696.820023] env[65443]: INFO networking_nsxv3.common.synchronization [req-cfcbb16b-5ed3-4bfd-a4eb-7a86e4d4915a req-efc90c7d-f2d5-4686-b287-b5268bfaeeb6 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 696.820319] env[65443]: INFO networking_nsxv3.common.synchronization [req-cfcbb16b-5ed3-4bfd-a4eb-7a86e4d4915a req-efc90c7d-f2d5-4686-b287-b5268bfaeeb6 service nova] Enqueued Resource ID: e14ac33d-a9e4-41db-8a22-413315718f51 with Priority: HIGHEST for action port [ 696.820717] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 696.820852] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 696.820947] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e14ac33d-a9e4-41db-8a22-413315718f51 with Priority: HIGHEST for action port [ 696.821241] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.821365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.821582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.821686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.821837] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e14ac33d-a9e4-41db-8a22-413315718f51 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.821931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.822027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.823159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.823159] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e14ac33d-a9e4-41db-8a22-413315718f51',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.023568] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0bbbea39-84cc-41b2-aac2-1acc4ce9d733 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 697.024335] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 697.024672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.024799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.024869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.025915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.026050] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.197477] env[65443]: INFO networking_nsxv3.common.synchronization [None req-d66453ab-8657-4fbf-bce6-da010d0fe292 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 697.198111] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 697.198449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.198623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.325489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e14ac33d-a9e4-41db-8a22-413315718f51 with status ACTIVE [ 697.325489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.325589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.325589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.326042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.326042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.326754] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.326754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.326754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.326754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.326754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.326962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.327735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.327735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.327735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.327735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.327735] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e14ac33d-a9e4-41db-8a22-413315718f51 is going to be updated. [ 697.361621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.361814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.362179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.362179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.362288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.362490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e14ac33d-a9e4-41db-8a22-413315718f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.560943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.560943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.560943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.560943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.560943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.560943] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 already deleted. [ 697.560943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.561588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.561588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.561588] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.567578] env[65443]: INFO networking_nsxv3.common.synchronization [None req-a9d78639-c192-4cc1-944e-f7fe68d2521e tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: eeec8465-6285-4a02-94d8-8c193f90710e with Priority: HIGHEST for action security_group_rules [ 697.567866] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeec8465-6285-4a02-94d8-8c193f90710e with Priority: HIGHEST for action security_group_rules [ 697.568012] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eeec8465-6285-4a02-94d8-8c193f90710e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.569028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.569028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.569028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.569028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eeec8465-6285-4a02-94d8-8c193f90710e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.710252] env[65443]: INFO networking_nsxv3.common.synchronization [None req-970a765e-bdf1-4468-bac4-46a87fbade36 tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: eeec8465-6285-4a02-94d8-8c193f90710e with Priority: HIGHEST for action security_group_rules [ 697.711337] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeec8465-6285-4a02-94d8-8c193f90710e with Priority: HIGHEST for action security_group_rules [ 697.712991] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eeec8465-6285-4a02-94d8-8c193f90710e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.712991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.795655] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 697.795907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.796127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.796490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.796571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.796682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.797199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.797199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.797199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.797199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.797199] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.800484] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4ed3a5ac-e85d-4325-83ac-59d42a5bec4f None None] Enqueued Resource ID: 3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba with Priority: HIGHEST for action port [ 697.801607] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba with Priority: HIGHEST for action port [ 697.802962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.802962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.802962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.802962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.802962] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.088148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.088513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.088513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.088615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.088729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.088864] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 already deleted. [ 698.088961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.092752] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.092915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.092957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.093330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.093330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.093330] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eeec8465-6285-4a02-94d8-8c193f90710e already deleted. [ 698.093482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.093540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.093685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.093768] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eeec8465-6285-4a02-94d8-8c193f90710e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.300567] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.300737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.300817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.301059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.301747] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.301888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.301946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.302856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.303817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.303978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.304223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.304338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.304407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.304613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.304773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.304872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.304935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.305094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.305174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.305258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.305349] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.306419] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba [ 698.306666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.307482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.307482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.308442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.308560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.308660] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba already deleted. [ 698.308773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f07602b-c9bc-4d2f-8fc3-4fdbcdcd1bba" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.620810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.620810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.620810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.620810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.620810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.620810] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eeec8465-6285-4a02-94d8-8c193f90710e already deleted. [ 698.620810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eeec8465-6285-4a02-94d8-8c193f90710e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.723314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 698.724261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.724580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.724833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.725048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.725200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.725287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.725456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.725542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.725629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.725861] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.725982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.726163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.726291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.726440] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.726540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.726601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.726827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.726827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.726918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.726991] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.728214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.729375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.729555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.729699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.729791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.729946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.731540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.731722] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.810618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 698.836499] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.836499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.836499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.837251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.837251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.837251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.837251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.837251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.837251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.837799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.837799] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.837799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.837799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.838067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.838067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.838159] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.838227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.838285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.838426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.838502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.838584] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be created. [ 698.913115] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.913115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.913115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.913115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.913115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.926845] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 699.234566] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2c637c-a7f1-415d-b0a1-fc76f318aea5: rpc.has_security_group_logging(os_id): False [ 699.235846] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.258301] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.258509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.258601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.261619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.261832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.262953] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.263175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.263263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.263582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.263688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.263990] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.264312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.264413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.264656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.264765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.265153] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.266099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.266099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.266099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.266099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.266099] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be created. [ 699.363474] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.363774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.363774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.364237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.364310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.387293] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 699.738902] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.245211] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.245211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.245211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.245211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.245211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.245211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 700.272210] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.272581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.272801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.273137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.273394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.287826] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 700.448207] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e2bede63-ab4c-42a2-9bce-d909bda2b2a7 None None] Enqueued Resource ID: 2f680d1a-3e1d-446f-ac5b-244c0d7cdac4 with Priority: HIGHEST for action port [ 700.448766] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f680d1a-3e1d-446f-ac5b-244c0d7cdac4 with Priority: HIGHEST for action port [ 700.449201] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f680d1a-3e1d-446f-ac5b-244c0d7cdac4 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.449347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f680d1a-3e1d-446f-ac5b-244c0d7cdac4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.449497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f680d1a-3e1d-446f-ac5b-244c0d7cdac4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.449800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f680d1a-3e1d-446f-ac5b-244c0d7cdac4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.449800] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f680d1a-3e1d-446f-ac5b-244c0d7cdac4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.635942] env[65443]: INFO networking_nsxv3.common.synchronization [req-c932f2a0-7f32-4a82-90f7-28484fa9edf2 req-1992838f-1a42-4160-926d-f2aab6827686 tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 700.635942] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 700.635942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.635942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.942374] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 700.942623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.952551] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f680d1a-3e1d-446f-ac5b-244c0d7cdac4 [ 700.953216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.953216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.953216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.953483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.953483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.953483] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f680d1a-3e1d-446f-ac5b-244c0d7cdac4 already deleted. [ 700.953483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f680d1a-3e1d-446f-ac5b-244c0d7cdac4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.273939] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-436 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.274354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.274354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.274532] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.276249] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.276249] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.276249] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.276249] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.276249] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.276249] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.276249] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.276249] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.276249] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.276249] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.276249] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.276606] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.306898] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.307240] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.307240] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.307392] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-436" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.307753] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.307923] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.308069] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.308416] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.308543] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1fa98c-28cc-4540-b505-ffbe4a5f7f51',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.404578] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 701.404828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.405064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.405334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.405419] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.812402] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.813760] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.813760] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.813760] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.813760] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.813760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 not found, creating... [ 701.813760] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.814059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.814059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.814122] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.814246] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.814758] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.814918] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.815471] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.815471] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.815471] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.815929] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 is going to be created. [ 701.844023] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.844023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.844023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.845625] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.845625] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.845625] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.911753] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.912394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.300633] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 702.302289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.302289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.302289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.302289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.302289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.302289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.302556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.302556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.302615] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.566109] env[65443]: INFO networking_nsxv3.common.synchronization [req-c932f2a0-7f32-4a82-90f7-28484fa9edf2 req-8fd5885a-09a7-49a4-8971-3684ed0b9462 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 702.566288] env[65443]: INFO networking_nsxv3.common.synchronization [req-c932f2a0-7f32-4a82-90f7-28484fa9edf2 req-8fd5885a-09a7-49a4-8971-3684ed0b9462 service nova] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 702.566416] env[65443]: INFO networking_nsxv3.common.synchronization [req-c932f2a0-7f32-4a82-90f7-28484fa9edf2 req-8fd5885a-09a7-49a4-8971-3684ed0b9462 service nova] Enqueued Resource ID: 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 with Priority: HIGHEST for action port [ 702.567010] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_rules [ 702.567152] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 702.567249] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 with Priority: HIGHEST for action port [ 702.567519] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.567623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.567850] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.567899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.568284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.568434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.568526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.568692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.568773] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e1fa98c-28cc-4540-b505-ffbe4a5f7f51',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.805183] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.073524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 with status ACTIVE [ 703.073902] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.074147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.074229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.074567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.074716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.074978] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.075142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.075243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.075468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.075585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.075875] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.076039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.076140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.076353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.076468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.076595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e1fa98c-28cc-4540-b505-ffbe4a5f7f51 is going to be updated. [ 703.108578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.108845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.108845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.109206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.109397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.109620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e1fa98c-28cc-4540-b505-ffbe4a5f7f51" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.194295] env[65443]: INFO networking_nsxv3.common.synchronization [None req-1e671524-44ed-484b-aa8e-86d45c8187bf None None] Enqueued Resource ID: 509f902b-0f13-41ad-ab07-2cadac9cb03e with Priority: HIGHEST for action port [ 703.195103] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 509f902b-0f13-41ad-ab07-2cadac9cb03e with Priority: HIGHEST for action port [ 703.195381] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-509f902b-0f13-41ad-ab07-2cadac9cb03e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.195510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-509f902b-0f13-41ad-ab07-2cadac9cb03e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.195596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-509f902b-0f13-41ad-ab07-2cadac9cb03e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.195828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-509f902b-0f13-41ad-ab07-2cadac9cb03e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.195918] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('509f902b-0f13-41ad-ab07-2cadac9cb03e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.308514] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.698521] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 509f902b-0f13-41ad-ab07-2cadac9cb03e [ 703.698762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.698943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.699023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.699222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.699352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.699518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:509f902b-0f13-41ad-ab07-2cadac9cb03e already deleted. [ 703.699781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-509f902b-0f13-41ad-ab07-2cadac9cb03e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.811821] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.812870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.812870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.812870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.812870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.812870] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 703.842954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.843597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.845091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.845091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.845091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.856272] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 705.735496] env[65443]: INFO networking_nsxv3.common.synchronization [req-63427810-4075-40b4-a724-4eeeff14e69b req-37f814cd-bec5-4fb1-9fde-72f1f0454cff tempest-FloatingIPsAssociationTestJSON-1022144113 tempest-FloatingIPsAssociationTestJSON-1022144113-project-member] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 705.736087] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGHEST for action security_group_members [ 705.736421] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.736547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.736612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.736825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.736974] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.738316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.738316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.738316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.738968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.738968] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.872630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 705.873065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.873065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.873429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.873429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.873429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.873429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.873429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.873429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.874199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.874199] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.875481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.875733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.875928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.876067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.876182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.876341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.876426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.876535] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.940395] env[65443]: INFO networking_nsxv3.common.synchronization [req-58dcc597-708e-4a89-ad22-131d6b2c9104 req-6806fe7e-a667-4d83-b443-feb1396bca41 tempest-VolumesAdminNegativeTest-1869350700 tempest-VolumesAdminNegativeTest-1869350700-project-member] Enqueued Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 705.940395] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d with Priority: HIGHEST for action security_group_members [ 705.940395] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb18cd6e-092e-4f1e-972b-3476700e4c4d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.940395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.940395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.940734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.940945] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.941087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.941155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.941468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.941575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.941681] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb18cd6e-092e-4f1e-972b-3476700e4c4d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.117411] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 706.117744] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 706.118171] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 706.118307] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 706.119370] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.119535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.119610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.119990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.120474] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.120657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.120924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.121284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.122441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.122441] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.123984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.124301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.124384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.124630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.125124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.125124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.125124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.125362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.125362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.125695] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.198595] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 706.198595] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 706.198595] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_rules [ 706.198595] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 706.198595] env[65443]: INFO networking_nsxv3.common.synchronization [req-a744bca0-2140-4894-a90a-7d848bb56109 req-0338bc2f-499c-4d2c-b556-091e7f838c05 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 706.198905] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 706.199045] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_rules [ 706.199147] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 706.199235] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 706.199320] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 706.199640] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.202343] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.202343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.202343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.202343] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.202343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e08cf6-f018-4e17-81af-9ecaca9b77dd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.205051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.205051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.205051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.205051] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e08cf6-f018-4e17-81af-9ecaca9b77dd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.205051] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.205051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.205051] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.205051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.241562] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.241741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.241824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.243993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.243993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.243993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be updated. [ 706.278112] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.278271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.278342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.278560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.278725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.290521] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: IN_PROGRESS for 2s [ 706.380597] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.380845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.382089] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.446803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.446803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.446803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.446803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.447743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.447812] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.447914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.447974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.448182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.448261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.448347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d is going to be updated. [ 706.485915] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.486817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.486817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.486817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.486817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.497127] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: IN_PROGRESS for 2s [ 706.624665] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.629544] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.706108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.706267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.706532] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.707904] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e08cf6-f018-4e17-81af-9ecaca9b77dd with status ACTIVE [ 706.707904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.707904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.707904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.708353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.708353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.708425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.708540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.708579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.708725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.708800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.708880] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd is going to be updated. [ 706.732038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.732038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.732038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.732038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.732300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.732330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.885474] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.130321] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.132992] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.389087] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.389087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.389264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.392932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.392932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.392932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 707.432356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.432512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.432568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.432776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.432914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.444407] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 707.638212] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.638395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.638510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.638760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.638856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.638982] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 707.640745] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.640861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.640928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.642157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.642254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.642349] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be created. [ 707.674823] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.675483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.675564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.675770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.675928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.682938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.683093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.683164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.683350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.684137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.690656] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: UNINITIALIZED for 2s [ 707.694040] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 707.809874] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 707.810094] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 707.810256] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 707.810767] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 707.810902] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 707.810997] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 707.811547] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.811687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.811778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.812058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.812249] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.812362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.812426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.812589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.812668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.812779] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.813713] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.813844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.814055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.814157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.871058] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 707.871058] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 707.871058] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_rules [ 707.871058] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 707.871372] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_rules [ 707.871372] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 707.871481] env[65443]: INFO networking_nsxv3.common.synchronization [req-d838a0b6-015a-4790-9804-33455fd5f058 req-50b5f2fc-8f05-4947-9e7a-787b752ca02c tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 707.872083] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 707.872219] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_rules [ 707.872327] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 707.872418] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd with Priority: HIGHEST for action port [ 707.872505] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_rules [ 707.872606] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 707.872722] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 707.873118] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.873222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.873430] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.873551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.873613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.873869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.873938] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.874800] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.874927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.875356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e08cf6-f018-4e17-81af-9ecaca9b77dd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.875514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.875586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.875773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.875863] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e08cf6-f018-4e17-81af-9ecaca9b77dd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.876677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.876778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.876983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.877094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.877249] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.877331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.307937] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 in Status: SUCCESS [ 708.308382] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 deletion is rescheduled due to dependency. [ 708.308382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.316580] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.378623] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21e08cf6-f018-4e17-81af-9ecaca9b77dd with status ACTIVE [ 708.378866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.379099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.379099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.379397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.379508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.379721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.380088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.380198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.380410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.380508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.380726] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.380856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.380926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.381142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.381245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.381341] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21e08cf6-f018-4e17-81af-9ecaca9b77dd is going to be updated. [ 708.382773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.382929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.408964] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.409237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.409414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.409760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.409953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.410268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e08cf6-f018-4e17-81af-9ecaca9b77dd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.508585] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d in Status: SUCCESS [ 708.508585] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb18cd6e-092e-4f1e-972b-3476700e4c4d deletion is rescheduled due to dependency. [ 708.508585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb18cd6e-092e-4f1e-972b-3476700e4c4d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.819070] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.323700] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.324274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.324274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.324274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.324366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.324517] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be created. [ 709.354418] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.354584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.354651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.354864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.355088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.366382] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: UNINITIALIZED for 2s [ 709.462400] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 709.462661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.462924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.463157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.463348] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.463466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.463584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.463716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.463799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.463884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.464067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.464168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.464241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.464439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.464643] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.464789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.464883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.467976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.468052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.468188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.468309] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.651342] env[65443]: INFO networking_nsxv3.common.synchronization [req-566323c3-a7a7-4605-b033-d60f39166c97 req-4d1818b8-b129-4f65-b797-7110e419688b tempest-ImagesOneServerTestJSON-1207735951 tempest-ImagesOneServerTestJSON-1207735951-project-member] Enqueued Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 709.652153] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGHEST for action security_group_members [ 709.652616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.652616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.652616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.652879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.653050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.653121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.653121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.653512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.653512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.653512] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.704238] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 709.704457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.704628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.704858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.705037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.705160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.705227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.705386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.705469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.705569] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.709948] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 709.710041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.712190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.712642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.712751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.712927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.713041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.713307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.713394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.713536] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.716955] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.971847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2c637c-a7f1-415d-b0a1-fc76f318aea5: rpc.has_security_group_logging(os_id): False [ 710.001609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.001850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.001850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.002251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.002339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.002785] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.002923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.002990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.003187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.003272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.003515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.003565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.003607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.003749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.003825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.004057] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.004207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.004276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.004417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.004563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.004613] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 710.118020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.118020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.118020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.118020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.118020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.135822] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 710.159843] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.159843] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.159843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.159843] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 is going to be updated. [ 710.195175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.195424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.195424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.195866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.195866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.213519] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: IN_PROGRESS for 2s [ 710.221071] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.221071] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.722061] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.723491] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.723689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.723882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.724741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.724741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.724741] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 710.756788] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.757079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.757079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.757264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.757417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.767954] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 711.227804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.227804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.227804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.228113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.228251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.228391] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 711.259686] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.259885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.259966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.260217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.260508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.284568] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 711.377445] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: SUCCESS [ 711.378725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.378725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.378725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.378725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.378725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.378989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.379088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.379199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.379244] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.882165] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.153023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 712.153304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.153861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.154095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.154185] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.224462] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: IN_PROGRESS for 4s [ 712.322799] env[65443]: INFO networking_nsxv3.common.synchronization [req-30d5e2f1-b146-45bf-a096-706033f3c53f req-e21d3b79-932d-4a18-8238-788ceafc8b61 tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 712.323449] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 712.323869] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.324023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.324196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.325238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.325238] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.325238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.325238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.325238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.325238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.325238] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.385266] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.632228] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.632319] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.632584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.632707] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.632973] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.633920] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.633920] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.633920] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.633920] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.633920] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.634159] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.634305] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.634431] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.634561] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.634684] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.634831] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.657125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.657312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.657400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.657592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.657753] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.657851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.657915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.658064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.658148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.658233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.658321] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.673338] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.673500] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.673629] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.673794] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-120" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.674182] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-771a726b-1aa2-4d13-8354-38c18cbed1b9 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.674378] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.674518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.675355] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.675541] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771a726b-1aa2-4d13-8354-38c18cbed1b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.779286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 712.779517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.779667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.779921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.780082] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.780197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.780258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.780411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.780492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.780622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.780671] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.781670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.782057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.782737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.783394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.783548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.783789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.784542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.784766] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.828168] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.887152] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.887490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.887490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.887849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.889077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.889308] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be updated. [ 712.930396] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.930591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.930647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.930936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.931158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.941752] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: IN_PROGRESS for 2s [ 713.161229] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.163347] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.163347] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.163347] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.163347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.163969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.163969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.163969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.163969] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.178676] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.180509] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 771a726b-1aa2-4d13-8354-38c18cbed1b9 not found, creating... [ 713.180509] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.180509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.180994] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.180994] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.180994] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.181178] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.181313] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.181447] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 771a726b-1aa2-4d13-8354-38c18cbed1b9 is going to be created. [ 713.206244] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.206478] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.206605] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.206886] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.207137] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.207517] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.286563] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.289574] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.306220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 713.306464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.307139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.307437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.307687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.307820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.307921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.308121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.308234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.308362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.308470] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.309829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.310062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.310324] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.310500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.310599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.310783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.310874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.310970] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.331991] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.665533] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2c637c-a7f1-415d-b0a1-fc76f318aea5: rpc.has_security_group_logging(os_id): False [ 713.687410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.687611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.687611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.687831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.687925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.688161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.688262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.688325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.688478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.688557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.688730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.688825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.688887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.689035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.689110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.689294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.689416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.689448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.689581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.689645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.689749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 713.759564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.759751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.759799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.760034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.760146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.775675] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 713.789184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f: rpc.has_security_group_logging(os_id): False [ 713.792849] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.813889] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.814256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.814370] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.816036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.816163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.816227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.816441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.816551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.816764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.816898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.816987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.817367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.817437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.817544] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be created. [ 713.835143] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.835143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.835143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.835342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.835624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.835624] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 713.875224] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.875405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.875446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.875658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.875832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.900389] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.900389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.900389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.900882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.900882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.904555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 713.919994] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 713.953743] env[65443]: INFO networking_nsxv3.common.synchronization [req-30d5e2f1-b146-45bf-a096-706033f3c53f req-73f62bd8-515f-49a1-ae6e-68dc3d86a4b8 service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 713.953743] env[65443]: INFO networking_nsxv3.common.synchronization [req-30d5e2f1-b146-45bf-a096-706033f3c53f req-73f62bd8-515f-49a1-ae6e-68dc3d86a4b8 service nova] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 713.953743] env[65443]: INFO networking_nsxv3.common.synchronization [req-30d5e2f1-b146-45bf-a096-706033f3c53f req-73f62bd8-515f-49a1-ae6e-68dc3d86a4b8 service nova] Enqueued Resource ID: 771a726b-1aa2-4d13-8354-38c18cbed1b9 with Priority: HIGHEST for action port [ 713.954286] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_rules [ 713.954420] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 713.954518] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 771a726b-1aa2-4d13-8354-38c18cbed1b9 with Priority: HIGHEST for action port [ 713.954831] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.954948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.955079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.955679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.955679] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.956496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.957536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.957536] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-771a726b-1aa2-4d13-8354-38c18cbed1b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.957536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.957536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.959140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.959186] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('771a726b-1aa2-4d13-8354-38c18cbed1b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.243892] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9c98539-6490-4aa2-80d1-381c6299bd04 in Status: SUCCESS [ 714.244109] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 deletion is rescheduled due to dependency. [ 714.244258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.298232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.298371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.298479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.298661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.298793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.298870] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 714.320013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.340987] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.341176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.341233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.342799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.342799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.353142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 714.461577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.461747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.465057] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 771a726b-1aa2-4d13-8354-38c18cbed1b9 with status ACTIVE [ 714.465641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.465641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.465641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.465858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.465914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.466521] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.466521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.466521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.466521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.466521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.466758] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.466758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.466758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.466901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.467864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.467864] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 771a726b-1aa2-4d13-8354-38c18cbed1b9 is going to be updated. [ 714.489130] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.489281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.489319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.489515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.489642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.489875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-771a726b-1aa2-4d13-8354-38c18cbed1b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.823669] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.823669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.823669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.823669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.823669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.823669] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 714.873925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.874379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.874554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.874967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.875255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.896495] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 714.964977] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: SUCCESS [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.964977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.964977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.964977] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.230349] env[65443]: INFO networking_nsxv3.common.synchronization [req-59a4eb51-e345-4ff2-94e0-ef74212a870f req-e24bbd31-48b4-49c4-8134-48978c364219 tempest-ServersTestManualDisk-536655571 tempest-ServersTestManualDisk-536655571-project-member] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 715.231977] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 715.232486] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.232688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.232800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.233222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.233463] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.233637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.233754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.234054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.234222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.234387] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.470858] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.617395] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-394 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.617981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-394" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.618419] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-394" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.618480] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-394" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.618785] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.618889] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.619338] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.619338] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.619459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.619616] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.620040] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.621041] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.621041] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.621041] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 715.621041] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.621041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.643257] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.643257] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 715.643257] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.643433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-394" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.643669] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-21d23eef-3a5f-448c-a32f-9809d0e54adf taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.643826] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.643940] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.644334] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.644536] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d23eef-3a5f-448c-a32f-9809d0e54adf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.736964] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.737411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.737999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.738466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.738553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.738859] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.739036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.739125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.739337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.739444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.739555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec already deleted. [ 715.739670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.792254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 715.792466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.922585] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 715.922794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.922982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.923210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.923394] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.923513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.923581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.923726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.923807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.923904] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.930133] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 715.930340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.930502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.930714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.930804] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.974310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc: rpc.has_security_group_logging(os_id): False [ 715.991483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.991690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.991769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.992056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.992150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.992370] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.992607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.992607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.992715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.992761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.992849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be created. [ 716.059919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.059919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.059919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.059919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.059919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.071921] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: IN_PROGRESS for 2s [ 716.137865] env[65443]: INFO networking_nsxv3.common.synchronization [req-d25a8337-f155-4bc3-a0b0-34c697e9b0c0 req-3cce0a49-066a-44dc-82f7-79300614dbcd tempest-ServersTestBootFromVolume-1705188138 tempest-ServersTestBootFromVolume-1705188138-project-member] Enqueued Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 716.139228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c113e23-4653-415c-8339-d252037cc64b with Priority: HIGHEST for action security_group_members [ 716.140161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c113e23-4653-415c-8339-d252037cc64b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.140399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.140681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.140898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.141128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.141296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.141401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.141879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.141879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.141879] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c113e23-4653-415c-8339-d252037cc64b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.147323] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.147662] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.147779] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.148161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.148407] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.148648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 21d23eef-3a5f-448c-a32f-9809d0e54adf not found, creating... [ 716.149021] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.149260] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.149439] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.149757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.149967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.150664] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.150901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.151108] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.151421] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.151614] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.151765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 21d23eef-3a5f-448c-a32f-9809d0e54adf is going to be created. [ 716.178774] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.179137] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.179394] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.179749] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.179977] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.180442] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.363114] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 716.363336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.363505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.363809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.363892] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.364017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.364084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.365332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.365332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.365332] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.425781] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.432575] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.433025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.644598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.644966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.645054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.645288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.645386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.645587] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.645698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.645755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.645896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.645973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.646074] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c113e23-4653-415c-8339-d252037cc64b is going to be updated. [ 716.680200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.680404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.680497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.680732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.680916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.693448] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: IN_PROGRESS for 2s [ 716.866415] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.913120] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 716.913392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.913574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.913787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.913972] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.914109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.914175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.914350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.914442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.914571] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.930602] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.944022] env[65443]: INFO networking_nsxv3.common.synchronization [req-59a4eb51-e345-4ff2-94e0-ef74212a870f req-a07151da-c179-4e04-bf83-a849f1b83b5b service nova] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 716.944022] env[65443]: INFO networking_nsxv3.common.synchronization [req-59a4eb51-e345-4ff2-94e0-ef74212a870f req-a07151da-c179-4e04-bf83-a849f1b83b5b service nova] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 716.944022] env[65443]: INFO networking_nsxv3.common.synchronization [req-59a4eb51-e345-4ff2-94e0-ef74212a870f req-a07151da-c179-4e04-bf83-a849f1b83b5b service nova] Enqueued Resource ID: 21d23eef-3a5f-448c-a32f-9809d0e54adf with Priority: HIGHEST for action port [ 716.944022] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_rules [ 716.944022] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 716.944594] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21d23eef-3a5f-448c-a32f-9809d0e54adf with Priority: HIGHEST for action port [ 716.945055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.945354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.945508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.945772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.945961] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.947830] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.948061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.948200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.948448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.948830] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.952081] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.952081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-21d23eef-3a5f-448c-a32f-9809d0e54adf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.952081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.952081] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21d23eef-3a5f-448c-a32f-9809d0e54adf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.369403] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.417666] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.431142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.431298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.431369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.431578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.431942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.431942] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 717.452352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.452513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.452723] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.454530] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21d23eef-3a5f-448c-a32f-9809d0e54adf with status ACTIVE [ 717.454884] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.455781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.455999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.456653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.456790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.457251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.457559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.457665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.457915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.458054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.458348] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.458488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.458581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.458778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.458887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.459015] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21d23eef-3a5f-448c-a32f-9809d0e54adf is going to be updated. [ 717.494876] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.495077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.495148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.495363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.495524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.498129] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.498227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.498269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.498456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.498577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.498723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21d23eef-3a5f-448c-a32f-9809d0e54adf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.507390] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 717.873110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.873110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.873110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.873110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.873110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.873110] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 717.904578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.904717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.904789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.904997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.905158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.914994] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 717.923819] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.956853] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.046676] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-7b0a8547-0357-4058-a649-62eb89c8669b tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 718.047621] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 718.047745] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.047879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.047942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.048303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.048473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.048582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.048647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.048879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.048939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.049081] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.088254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: SUCCESS [ 718.088254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.426177] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.426439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.426439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.426743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.427073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.427073] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 718.463107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.463107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.463107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.463107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.463107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.464146] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.464269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.464340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.464509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.464591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.464678] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec is going to be created. [ 718.475206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 718.493559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.493559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.493559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.493559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.493559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.504485] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: UNINITIALIZED for 2s [ 718.523451] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.523639] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.524644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.525102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.525461] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.525676] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.525795] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.526085] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.526269] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.526656] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.526874] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 718.527079] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 718.527311] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 718.527517] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 718.527722] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 718.527911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 718.548720] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 718.548781] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 718.548866] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 718.549046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.549361] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.549610] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.549752] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.550202] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.550348] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f04c2a0-fefe-4c8c-92af-5fafbf467bc1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.552795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.552795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.552795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.552795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.552795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.552795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.552997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.552997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.553437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.553437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.553437] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 already deleted. [ 718.553437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.705304] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c113e23-4653-415c-8339-d252037cc64b in Status: SUCCESS [ 718.705510] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c113e23-4653-415c-8339-d252037cc64b deletion is rescheduled due to dependency. [ 718.705640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c113e23-4653-415c-8339-d252037cc64b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.747074] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4a9872be-cccc-46f5-9a62-8294e69ae5fb tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 0a92e289-0857-446c-82c7-3e903a7ee665 with Priority: HIGHEST for action security_group_rules [ 718.747074] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a92e289-0857-446c-82c7-3e903a7ee665 with Priority: HIGHEST for action security_group_rules [ 718.747195] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a92e289-0857-446c-82c7-3e903a7ee665 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.747327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.747418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.747692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.747777] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a92e289-0857-446c-82c7-3e903a7ee665',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.025439] env[65443]: INFO networking_nsxv3.common.synchronization [None req-26fdfe27-3bd4-4a9c-9389-de2ad533c15b tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 0a92e289-0857-446c-82c7-3e903a7ee665 with Priority: HIGHEST for action security_group_rules [ 719.026877] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a92e289-0857-446c-82c7-3e903a7ee665 with Priority: HIGHEST for action security_group_rules [ 719.026877] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a92e289-0857-446c-82c7-3e903a7ee665 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.026877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.052591] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.056022] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 not found, creating... [ 719.056022] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.056022] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.056477] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.056477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.056477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.056477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.056477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.056477] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 is going to be created. [ 719.079293] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.079497] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.079692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.079859] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.080390] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.080390] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.270956] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.271211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.271299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.271524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.271616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.271721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a92e289-0857-446c-82c7-3e903a7ee665 already deleted. [ 719.271806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.271985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.272166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.272361] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a92e289-0857-446c-82c7-3e903a7ee665',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.518811] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 719.519197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.519197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.519464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.519768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.520033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.520110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.520297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.520761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.520761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.520761] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.797107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.797262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.797356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.797564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.797657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.797749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a92e289-0857-446c-82c7-3e903a7ee665 already deleted. [ 719.797840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a92e289-0857-446c-82c7-3e903a7ee665" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.869939] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-7d3be446-0dd3-4bf7-bb30-28d24425913e service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 719.870269] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-7d3be446-0dd3-4bf7-bb30-28d24425913e service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 719.870398] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-7d3be446-0dd3-4bf7-bb30-28d24425913e service nova] Enqueued Resource ID: 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 with Priority: HIGHEST for action port [ 719.871081] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 719.871305] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 719.871359] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 with Priority: HIGHEST for action port [ 719.871637] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.871777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.871894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.872319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.873265] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.875643] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.875830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.875907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.876357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.876512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.876563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.876837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.876937] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.880031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.880031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.880031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.880031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.880031] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f04c2a0-fefe-4c8c-92af-5fafbf467bc1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.938156] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.938156] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.938156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.938578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.938578] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.024642] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.027304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.027497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.027910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.028245] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.028413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.028535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.028707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.028895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.029109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.029341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.029481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.029551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.029719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.029900] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.030073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.032871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.033109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.033345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.033345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.033609] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.381820] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.382042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.383421] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 with status ACTIVE [ 720.383664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.383814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.383883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.384562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.384562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.384562] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.384770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.384770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.384845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.384919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.385125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.385344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.385344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.385455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.385550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.385638] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f04c2a0-fefe-4c8c-92af-5fafbf467bc1 is going to be updated. [ 720.390036] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.413649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.415034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.415034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.415034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.415034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.415034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f04c2a0-fefe-4c8c-92af-5fafbf467bc1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.442719] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.523986] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.523986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.523986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.523986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.523986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.525029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.525029] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.525029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: SUCCESS [ 720.525529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.525529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.525672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.525707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.525801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.525865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.526388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.526388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.526388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.526388] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.535796] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 373eadf5-9140-4fc8-8636-38b8598454fa: rpc.has_security_group_logging(os_id): False [ 720.567549] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.567857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.567857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.568057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.568220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.568282] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.569247] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.569535] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.569535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.569535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.569657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.569813] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 720.645198] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.645421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.646542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.646542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.646542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.671655] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 720.889985] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.944638] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f: rpc.has_security_group_logging(os_id): False [ 720.968444] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.968444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.968444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.968792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.968830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.969072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.969185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.969261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.969469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.969531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.970438] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 721.030019] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-7e03fe4f-44b1-49b1-aea1-ff6aa11fa8c9 tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 721.030019] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 721.030019] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 721.033784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.033920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.034163] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.057408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.057605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.057657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.057846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.057986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.060594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.060736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.060799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.060991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.061092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.061280] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.061377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.061440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.061588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.061695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.062379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.062379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.062379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.062379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.062379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.062727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.062727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.062727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.062896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.062942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.062995] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 721.098608] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 721.141265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.141265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.141265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.141265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.141534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.171910] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 721.386526] env[65443]: INFO networking_nsxv3.common.synchronization [req-3290bf36-20c0-4aff-bed1-fc93db0476e5 req-4ce2c922-43f9-42ef-905f-8c3b44abbee6 tempest-ServersAdminNegativeTestJSON-1088238682 tempest-ServersAdminNegativeTestJSON-1088238682-project-member] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 721.387993] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGHEST for action security_group_members [ 721.387993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.387993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.387993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.387993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.388297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.388297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.388297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.388396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.388426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.388508] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.393339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.393490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.393562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.393765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.393858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393955] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be created. [ 721.435269] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.435483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.435526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.435740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.435900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.448761] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: UNINITIALIZED for 2s [ 721.535988] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ded103e4-c215-45f9-85d6-afc52b8ad0ec: rpc.has_security_group_logging(os_id): False [ 721.555798] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.555954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.556049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.556274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.556522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.556628] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.556730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.556792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.556959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.557050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.557138] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec is going to be created. [ 721.621901] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.622075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.622137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.622328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.622508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.634815] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: IN_PROGRESS for 2s [ 721.719028] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.719028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.719028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.719028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.719028] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.719028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.719589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.719589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.719715] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.719922] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.720090] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.720161] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.720695] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.720695] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.720695] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.720695] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.753381] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.753381] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.753381] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.753381] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.754111] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.754111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.754111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.754318] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.754464] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.894546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.894726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.894806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.895084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.895192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.895383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.895484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.895546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.895698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.895776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.895864] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be updated. [ 721.942713] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.943127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.943296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.945016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.945016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.954324] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: IN_PROGRESS for 2s [ 722.258220] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.258220] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.258220] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.258698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.258698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.258698] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 not found, creating... [ 722.258777] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.258938] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.259059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.259290] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.259422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.259706] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.259895] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.260030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.260240] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.260366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.260497] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 is going to be created. [ 722.288393] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.288637] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.288741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.289038] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.289316] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.289581] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.693759] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 722.693759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.007862] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-f127e9a2-2cb6-432b-9a31-2ad8f205a969 service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 723.007862] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-f127e9a2-2cb6-432b-9a31-2ad8f205a969 service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 723.008131] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-f127e9a2-2cb6-432b-9a31-2ad8f205a969 service nova] Enqueued Resource ID: a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 with Priority: HIGHEST for action port [ 723.008804] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 723.008804] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 723.008909] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 with Priority: HIGHEST for action port [ 723.010235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.010235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.010235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.010235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.010702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.010702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.010702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.010975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.011236] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.116624] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 723.116979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.186128] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 723.186128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.186128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.186128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.186128] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.376183] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-816805d5-4ed4-44ae-888d-92fbae2613fb tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 723.376544] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 723.376882] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.376973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.472704] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 723.472851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.473459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.473679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.474076] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.474076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.474234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.474332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.474372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.474463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.474561] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.475578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.475758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.475937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.476056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.476405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.476405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.476405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.476560] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.514623] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 with status ACTIVE [ 723.514623] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.514623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.514623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.515079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.515079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.515079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.515180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.515261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.515688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.515688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.515688] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.515896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.515896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.515949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.516089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.516133] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9 is going to be updated. [ 723.544743] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.544903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.544976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.545268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.545356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.545629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1fb88ca-9768-4db1-a0f4-a5c9c636f9e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.684850] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: SUCCESS [ 723.684850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.688782] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.688782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.688782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.688782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.689250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.689494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.689755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.690186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.691598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.691598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.691598] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.857089] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.858184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.858184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.858184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.858184] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.858386] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.858386] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.858630] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.858797] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.859380] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.859380] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.859380] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.859631] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.859631] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 723.859738] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.860195] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.881111] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.881456] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 723.881523] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.881659] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-639" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.882028] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-01b46509-2b02-4da9-a6d9-87a6f01c314e taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.882211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.882324] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.882655] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.883092] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b46509-2b02-4da9-a6d9-87a6f01c314e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.966090] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33573b4-6e20-4958-b534-744277031b44 in Status: SUCCESS [ 723.966533] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33573b4-6e20-4958-b534-744277031b44 deletion is rescheduled due to dependency. [ 723.968025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.978865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.978989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.979779] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.194128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.195562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.195562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.195971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.195971] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.196273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.196273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.196415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.196415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.197263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.197263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.197263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.197599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.197599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.197599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.197599] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.388801] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.388801] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 01b46509-2b02-4da9-a6d9-87a6f01c314e not found, creating... [ 724.388801] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.388801] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.389223] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.389223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.389223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.389223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.389223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.389223] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 01b46509-2b02-4da9-a6d9-87a6f01c314e is going to be created. [ 724.418805] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.418805] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.418805] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.420401] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.420401] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.420401] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.484766] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.701162] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 724.724217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.724365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.724427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.724718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.724814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.725010] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.725120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.725183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.725358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.725441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.725631] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.725752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.725798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.726629] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.726629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.726629] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 724.799410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.799626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.799725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.800017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.800203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.820807] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 724.986764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.987152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.987152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.987229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.987293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.987726] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 725.045702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.046796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.046902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.047780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.047904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.066342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 725.255625] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-219972ca-f9d5-47b4-8f24-ee8f55466e68 service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 725.255808] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-219972ca-f9d5-47b4-8f24-ee8f55466e68 service nova] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 725.255945] env[65443]: INFO networking_nsxv3.common.synchronization [req-89f1b740-34ff-41b7-aca1-ba544f6b4659 req-219972ca-f9d5-47b4-8f24-ee8f55466e68 service nova] Enqueued Resource ID: 01b46509-2b02-4da9-a6d9-87a6f01c314e with Priority: HIGHEST for action port [ 725.256725] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_rules [ 725.257232] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 725.257232] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b46509-2b02-4da9-a6d9-87a6f01c314e with Priority: HIGHEST for action port [ 725.257725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.257725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.257952] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.257952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.258147] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-01b46509-2b02-4da9-a6d9-87a6f01c314e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.258280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.258280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.258514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.258585] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01b46509-2b02-4da9-a6d9-87a6f01c314e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.763145] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01b46509-2b02-4da9-a6d9-87a6f01c314e with status ACTIVE [ 725.763879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.764036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.764106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.765034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.765034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.765463] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.765463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.765463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.765614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.765614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.765734] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01b46509-2b02-4da9-a6d9-87a6f01c314e is going to be updated. [ 725.792822] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.793052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.793135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.793323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.793489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.795155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01b46509-2b02-4da9-a6d9-87a6f01c314e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.498295] env[65443]: INFO networking_nsxv3.common.synchronization [req-ddd090a5-2f83-41ac-a0d3-d72cca1c93a1 req-cc19442c-2360-475f-be53-81c3092fbd37 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 726.498888] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 726.499248] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.499383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.499452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.499716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.499879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.499975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.500325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.500540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.500595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.500695] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.839443] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 726.839443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.003105] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.003105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.003105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.003105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.003105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.003323] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.003367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.004062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.004062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.004062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.004062] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 already deleted. [ 727.004062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.022529] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.022733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.022820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.023165] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.024060] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.024060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.024060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.024060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.024060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.024290] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.024390] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.024500] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.024591] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.024697] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.024794] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.024947] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.045791] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.046023] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.046203] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.046308] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.046796] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.047146] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.047146] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.047529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.047590] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.077929] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 727.078177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.078784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.078922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.079061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.079183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.079249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.079403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.079648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.079648] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.515793] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3a3a62a8-63f5-4a13-a2fd-274a9f2ac593 None None] Enqueued Resource ID: a359d841-19ea-4ef2-878d-575066767d92 with Priority: HIGHEST for action port [ 727.516428] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a359d841-19ea-4ef2-878d-575066767d92 with Priority: HIGHEST for action port [ 727.516673] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a359d841-19ea-4ef2-878d-575066767d92 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.516799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a359d841-19ea-4ef2-878d-575066767d92" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.516862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a359d841-19ea-4ef2-878d-575066767d92" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.517146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a359d841-19ea-4ef2-878d-575066767d92" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.517448] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a359d841-19ea-4ef2-878d-575066767d92',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.550346] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.550598] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.550735] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.550955] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.551119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.551301] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a not found, creating... [ 727.551519] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.551957] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.551957] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.552121] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.552242] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.552515] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.552668] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.552822] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.552965] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.553215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.553351] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a is going to be created. [ 727.577721] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.577980] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.578067] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.578455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.578561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.578781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.582729] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.019476] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a359d841-19ea-4ef2-878d-575066767d92 [ 728.022820] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.022820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.022820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.022820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.022820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.022820] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a359d841-19ea-4ef2-878d-575066767d92 already deleted. [ 728.023124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a359d841-19ea-4ef2-878d-575066767d92" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.085402] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.411609] env[65443]: INFO networking_nsxv3.common.synchronization [req-ddd090a5-2f83-41ac-a0d3-d72cca1c93a1 req-ff50480f-06b4-482f-82cd-4e0a5d900025 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 728.411767] env[65443]: INFO networking_nsxv3.common.synchronization [req-ddd090a5-2f83-41ac-a0d3-d72cca1c93a1 req-ff50480f-06b4-482f-82cd-4e0a5d900025 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 728.411991] env[65443]: INFO networking_nsxv3.common.synchronization [req-ddd090a5-2f83-41ac-a0d3-d72cca1c93a1 req-ff50480f-06b4-482f-82cd-4e0a5d900025 service nova] Enqueued Resource ID: 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a with Priority: HIGHEST for action port [ 728.412618] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 728.412826] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 728.412986] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a with Priority: HIGHEST for action port [ 728.413314] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.413483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.413660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.414104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.414104] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.415013] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.415130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.415209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.415429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.415599] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.415722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.415789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.416043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.416736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.416931] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.419578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.419578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.419578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.419578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.419578] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.587829] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.588404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.588630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.588976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.589168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.589342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 728.623047] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.623047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.623047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.623047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.623047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.633444] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 728.923154] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.923804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.923886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.923981] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a with status ACTIVE [ 728.924216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.924343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.924720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.924720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.924720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.924943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.925525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.925525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.925525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.925525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.925720] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.925720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.925720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.925861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.925890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.926464] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a is going to be updated. [ 728.948854] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.949048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.949048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.949271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.949447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.949614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54387ca6-7d5e-4c6d-92e1-7f9aca80cb4a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.970403] env[65443]: INFO networking_nsxv3.common.synchronization [req-47f17540-10e6-485f-8753-c6d534267896 req-5faf904b-0752-4a6f-9864-b5d5fbcd8950 tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 728.970949] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 728.971294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.971411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.971469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.971672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.971824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.972019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.972505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.972716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.972818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.972920] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.429488] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.475945] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.475945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.476244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.476750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.480251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.480251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.480251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.480251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.480251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.480251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.480251] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 729.520279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.520279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.520279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.520279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.520279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.534885] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 729.936063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.937289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.937289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.937289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.937289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.937289] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be created. [ 729.974171] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.974171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.974355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.974475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.974798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.988656] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: UNINITIALIZED for 2s [ 730.649271] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 730.650553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.650553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.650553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.650553] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.650553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.650915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.651064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.651153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.651253] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.971950] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ad3e07aa-6827-4811-b2d8-f360d0f46508 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 730.971950] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 730.971950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.971950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.971950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.972752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.972752] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.105113] env[65443]: INFO networking_nsxv3.common.synchronization [None req-9dfd766d-3531-47dd-bb48-76f756dd978a tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 731.107518] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 731.107518] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.107518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.154155] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.497372] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.497372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.497680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.497680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.497783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.497783] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 already deleted. [ 731.497893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.499033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.499033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.499033] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.546947] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 731.547142] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 deletion is rescheduled due to dependency. [ 731.547254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.658280] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.830504] env[65443]: INFO networking_nsxv3.common.synchronization [None req-113761c9-bcb3-4be0-bdf4-b5e73d397878 None None] Enqueued Resource ID: 3fc5f764-b8f1-4647-9060-be5df53b52bd with Priority: HIGHEST for action port [ 731.831193] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fc5f764-b8f1-4647-9060-be5df53b52bd with Priority: HIGHEST for action port [ 731.831515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fc5f764-b8f1-4647-9060-be5df53b52bd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.831660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fc5f764-b8f1-4647-9060-be5df53b52bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.831750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fc5f764-b8f1-4647-9060-be5df53b52bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.834059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fc5f764-b8f1-4647-9060-be5df53b52bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.834059] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fc5f764-b8f1-4647-9060-be5df53b52bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.998590] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 731.998854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.998974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.999208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.999398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.999513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.999576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.999725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.999806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.999896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.003557] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.021844] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.022011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.022104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.022308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.022402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.022689] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 already deleted. [ 732.022689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.164231] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.164231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.164231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.164231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.164231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.164231] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 732.203046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.203046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.203046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.203046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.203046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.214330] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 732.335107] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fc5f764-b8f1-4647-9060-be5df53b52bd [ 732.335395] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.335554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.335646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.335889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.335993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.336121] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fc5f764-b8f1-4647-9060-be5df53b52bd already deleted. [ 732.336215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fc5f764-b8f1-4647-9060-be5df53b52bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.505981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.505981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.505981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.506826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.506826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.506826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.506826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.506826] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.874816] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e08c38e-e5e5-435a-9563-de3b978f991d req-b6d3d307-a1f0-4bc6-9964-a73ee6a9e4c5 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 732.876593] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 732.876956] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.877142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.877238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.878306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.878306] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.878306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.878306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.878306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.878306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.878306] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.009099] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7259b9-1e79-42d6-87f5-2acdaf792fd0: rpc.has_security_group_logging(os_id): False [ 733.035640] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.035864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.035905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.036226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.037321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.037321] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.037321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.037321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.037321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.038938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.038938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.038938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.038938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.039417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.039474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.040192] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.040192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.040192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.040192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.040192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.040487] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be created. [ 733.121438] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.121634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.121634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.122029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.122137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.150254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 733.380169] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.462357] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.462688] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.462779] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.463071] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.463343] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.463520] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.463634] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.463855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.463993] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.464213] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.464341] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 733.464456] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 733.464555] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 733.464686] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 733.464975] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 733.465058] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 733.491570] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 733.491734] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 733.492467] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 733.492467] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.492662] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-07bddfa2-c335-4492-87a0-4256e303f545 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.494063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.494063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.494063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.494063] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07bddfa2-c335-4492-87a0-4256e303f545',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.884235] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.998901] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.998901] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 07bddfa2-c335-4492-87a0-4256e303f545 not found, creating... [ 733.998901] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.998901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.999923] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.999923] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.000506] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.000873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.002936] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.002936] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 07bddfa2-c335-4492-87a0-4256e303f545 is going to be created. [ 734.027773] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.028195] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.028195] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.028671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.028671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.028884] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.080357] env[65443]: INFO networking_nsxv3.common.synchronization [None req-30c33017-c221-45bb-89ae-54e268ec733f None None] Enqueued Resource ID: bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f with Priority: HIGHEST for action port [ 734.082222] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f with Priority: HIGHEST for action port [ 734.082644] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.082778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.082858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.083162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.083263] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.227625] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 4s [ 734.387101] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.387314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.387355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.387545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.387636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.387737] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 734.419144] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.419339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.419339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.419538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.419679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.433614] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 734.586136] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f [ 734.587416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.587583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.587658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.587938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.588272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.588272] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f already deleted. [ 734.588394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf0bfbe-7bbe-478d-a5c0-b3401a72f90f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.763775] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e08c38e-e5e5-435a-9563-de3b978f991d req-964f2f93-41fe-4403-ad0b-8078624ae509 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 734.764915] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e08c38e-e5e5-435a-9563-de3b978f991d req-964f2f93-41fe-4403-ad0b-8078624ae509 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 734.764915] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e08c38e-e5e5-435a-9563-de3b978f991d req-964f2f93-41fe-4403-ad0b-8078624ae509 service nova] Enqueued Resource ID: 07bddfa2-c335-4492-87a0-4256e303f545 with Priority: HIGHEST for action port [ 734.764915] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 734.764915] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 734.765519] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07bddfa2-c335-4492-87a0-4256e303f545 with Priority: HIGHEST for action port [ 734.765883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.766067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.766106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.766448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.766544] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.769279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.769279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.769279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-07bddfa2-c335-4492-87a0-4256e303f545 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.769279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.769279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.769556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.769640] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07bddfa2-c335-4492-87a0-4256e303f545',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.166285] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 735.166614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.217733] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-4d2cd829-fc2f-4a0d-99ec-6eef27cc6e68 tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 735.218289] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 735.218612] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.218736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.218820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.219434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.219615] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.219731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.219807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.220073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.220185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.220303] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.273093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.273271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.273462] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07bddfa2-c335-4492-87a0-4256e303f545 with status ACTIVE [ 735.273644] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.273762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.273842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.274079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.274166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.275322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.275322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.275322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.275662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.275662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.275662] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07bddfa2-c335-4492-87a0-4256e303f545 is going to be updated. [ 735.314782] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.314987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.315042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.315233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.315373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.315556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07bddfa2-c335-4492-87a0-4256e303f545" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.667182] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.667182] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.667182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.668136] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.668428] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.668667] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.668897] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.670154] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.670262] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.670352] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.697059] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.698161] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.698161] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.698161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.698161] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-ba7c86ce-750b-4158-a3e6-e2006eed34e5 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.698161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.698161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.698503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.698616] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba7c86ce-750b-4158-a3e6-e2006eed34e5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.722970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.723212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.723345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.723608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.723705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.723919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.724056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.724135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.724402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.724474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.724666] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 already deleted. [ 735.724666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.200978] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.200978] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.201391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.201456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.201614] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.201760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port ba7c86ce-750b-4158-a3e6-e2006eed34e5 not found, creating... [ 736.202069] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.202234] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.202345] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.202565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.202692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.202959] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.203292] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.203412] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.203733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.203733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.203845] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: ba7c86ce-750b-4158-a3e6-e2006eed34e5 is going to be created. [ 736.226860] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.226860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.227080] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.227264] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.227502] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.228235] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.239035] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 736.239035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.239189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.239320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.239513] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.241057] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.241057] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.241057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.241650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.241771] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.242715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.242875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.243494] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.243645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.243746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.243901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.243987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.244094] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.445081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 736.445310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.445468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.445681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.445867] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.445983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.446057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.446236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.446333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.446601] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.750395] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.751524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fefe930-a078-492b-8eab-26e076c8e507: rpc.has_security_group_logging(os_id): False [ 736.772424] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.772628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.772684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.772870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.772954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.773226] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.773345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.773442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.773606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.773685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.773857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.773951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.774021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.774158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.774239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.774418] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.774510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.774566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.774706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.774787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.774868] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be created. [ 736.844458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.844702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.844702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.845557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.845557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.859375] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 736.860082] env[65443]: INFO networking_nsxv3.common.synchronization [None req-939f1d0c-f349-4125-8465-92c2358ca7b4 None None] Enqueued Resource ID: 90c8dfb4-d26b-4099-8ffb-79ec56af2346 with Priority: HIGHEST for action port [ 736.860314] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90c8dfb4-d26b-4099-8ffb-79ec56af2346 with Priority: HIGHEST for action port [ 736.860921] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-90c8dfb4-d26b-4099-8ffb-79ec56af2346 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.863346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90c8dfb4-d26b-4099-8ffb-79ec56af2346" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.863346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90c8dfb4-d26b-4099-8ffb-79ec56af2346" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.863346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90c8dfb4-d26b-4099-8ffb-79ec56af2346" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.863346] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90c8dfb4-d26b-4099-8ffb-79ec56af2346',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.948682] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.072161] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-290d3aa2-51ae-49b9-877c-31ed35a5c30d service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 737.072363] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-290d3aa2-51ae-49b9-877c-31ed35a5c30d service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 737.072486] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-290d3aa2-51ae-49b9-877c-31ed35a5c30d service nova] Enqueued Resource ID: ba7c86ce-750b-4158-a3e6-e2006eed34e5 with Priority: HIGHEST for action port [ 737.073287] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 737.073543] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 737.073620] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba7c86ce-750b-4158-a3e6-e2006eed34e5 with Priority: HIGHEST for action port [ 737.073929] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.074963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.075160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.075647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.075713] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.076976] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.077174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.077333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.077563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.077784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.078491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.078990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.078990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.078990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.079162] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.080379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba7c86ce-750b-4158-a3e6-e2006eed34e5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.080379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.080379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.080670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.080670] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba7c86ce-750b-4158-a3e6-e2006eed34e5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.254293] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.334206] env[65443]: INFO networking_nsxv3.common.synchronization [None req-f462693d-db98-45bf-a46d-ef3d28381c7e tempest-ServersTestJSON-1600957378 tempest-ServersTestJSON-1600957378-project-member] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 737.335092] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 737.336014] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.336145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.336607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.336762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.336801] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.365212] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90c8dfb4-d26b-4099-8ffb-79ec56af2346 [ 737.366134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.366303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.366360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.366611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.366707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.366864] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90c8dfb4-d26b-4099-8ffb-79ec56af2346 already deleted. [ 737.366951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90c8dfb4-d26b-4099-8ffb-79ec56af2346" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.453101] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.477691] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4b9b106f-1216-4fa2-990a-8c7584eed527 tempest-ServersTestJSON-1600957378 tempest-ServersTestJSON-1600957378-project-member] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 737.480949] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 737.481583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.481759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.584428] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.585081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.585418] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.587272] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba7c86ce-750b-4158-a3e6-e2006eed34e5 with status ACTIVE [ 737.587506] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.587706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.587871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.588184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.588184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.589024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.589024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.589024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.589024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.589024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.589249] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.589249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.589249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.591184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.591184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.591184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba7c86ce-750b-4158-a3e6-e2006eed34e5 is going to be updated. [ 737.616763] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.616931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.617071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.617304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.617538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.618026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba7c86ce-750b-4158-a3e6-e2006eed34e5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.758580] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.759038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.759217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.759486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.759597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.759707] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 737.819675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.819900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.819900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.820097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.823116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.831661] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 737.860762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.861956] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 already deleted. [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.861956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.862551] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.955894] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.955894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.956049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.956630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.956630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.956630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 737.990100] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.990906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.991054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.991270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.991474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.006021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 738.083193] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-dd9e0c3f-0f04-4353-a290-0e9b9edb2fae tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 738.085776] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 738.086197] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.086299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.092647] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.411103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.411503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.411503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.411757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.411922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.412251] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 already deleted. [ 738.412403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.595970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.596231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.596299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.596696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.596696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.596696] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be created. [ 738.633637] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.633934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.633934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.634964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.635317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.653914] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: UNINITIALIZED for 2s [ 738.757717] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.757967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.758112] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.758590] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.758684] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.758825] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.759046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.759231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.759380] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.759590] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.759699] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.759801] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.760311] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.760449] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.760555] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.760688] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.786489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.786724] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.787126] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.787126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.787515] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-77f9db01-5964-4b02-b922-1bb316e9ab1a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.787722] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.787870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.788264] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.788441] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f9db01-5964-4b02-b922-1bb316e9ab1a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.838144] env[65443]: INFO networking_nsxv3.common.synchronization [req-277914eb-2bb2-4cad-8397-c0af0d14ed3d req-7f7b7944-814d-4bc8-b118-125f2f1eb66b tempest-VolumesAssistedSnapshotsTest-83228541 tempest-VolumesAssistedSnapshotsTest-83228541-project-member] Enqueued Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 738.838904] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 with Priority: HIGHEST for action security_group_members [ 738.839587] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-256b6662-e079-48f2-8a9b-ddfdeb035f28 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.839722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.839822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.840133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.840355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.840454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.840454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.840629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.840694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.840775] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('256b6662-e079-48f2-8a9b-ddfdeb035f28',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.872507] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 738.872814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.873577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.873844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.873981] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.109329] env[65443]: INFO networking_nsxv3.common.synchronization [None req-219aacd2-6188-4ba4-8a31-980a14b8fd28 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 739.111337] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 739.111949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.112411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.112579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.113110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.114428] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.293041] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.293041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.293041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.293041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.293041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.293041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 77f9db01-5964-4b02-b922-1bb316e9ab1a not found, creating... [ 739.294261] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.295066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.295676] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.296394] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.297063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.297598] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.298620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.298620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.298925] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.299314] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.299703] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 77f9db01-5964-4b02-b922-1bb316e9ab1a is going to be created. [ 739.319390] env[65443]: INFO networking_nsxv3.common.synchronization [None req-04e14b7c-4d3b-4c36-8cb9-94b39bbf5b22 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 739.320461] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 739.321265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.321265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.334424] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.334927] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.335120] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.335565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.335921] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.336311] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.343591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.343854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.343958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.344355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.344489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.344810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.344961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.345079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.345337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.345461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.345595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 is going to be updated. [ 739.378460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.379076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.409585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.409585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.409876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.409977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.410211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.422820] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: IN_PROGRESS for 2s [ 739.639407] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.639407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.639639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.639707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.639793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.639884] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 already deleted. [ 739.639992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.640255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.640413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.640499] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.842473] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 739.842689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.842897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.843189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.843383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.843508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.843588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.843748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.844312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.844412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.844507] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.025380] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 740.025641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.025970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.026736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.026736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.026736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.026736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.027439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.028526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.028526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.030519] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.073765] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-1995f686-9936-47bb-829c-fc283d8933b2 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 740.075140] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-1995f686-9936-47bb-829c-fc283d8933b2 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 740.075426] env[65443]: INFO networking_nsxv3.common.synchronization [req-5129b8a8-837f-41ed-9471-a727f1906f81 req-1995f686-9936-47bb-829c-fc283d8933b2 service nova] Enqueued Resource ID: 77f9db01-5964-4b02-b922-1bb316e9ab1a with Priority: HIGHEST for action port [ 740.076777] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 740.076999] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 740.077176] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77f9db01-5964-4b02-b922-1bb316e9ab1a with Priority: HIGHEST for action port [ 740.077532] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.077703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.078040] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.078285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.078529] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-77f9db01-5964-4b02-b922-1bb316e9ab1a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.078652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.078762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.079080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.079213] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77f9db01-5964-4b02-b922-1bb316e9ab1a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.184898] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.184898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.184898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.184898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.184898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.184898] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 already deleted. [ 740.184898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.347167] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.348026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.348026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.348026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.348180] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.348180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.348295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.348411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.348500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.348589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.348762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.348866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.348919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.349095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.349232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.349336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.349395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.349532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.349608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.349785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.350150] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.535409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.535767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.535767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.535864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.536235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.536235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.536235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.536405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.536405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.536477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.536605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.536698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.536757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.536895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.537041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.537136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.537195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.537329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.537404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.537484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.537569] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.585016] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77f9db01-5964-4b02-b922-1bb316e9ab1a with status ACTIVE [ 740.585016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.585016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.585016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.585016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.585016] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77f9db01-5964-4b02-b922-1bb316e9ab1a is going to be updated. [ 740.609635] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.609782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.609854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.610180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.610389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.610614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77f9db01-5964-4b02-b922-1bb316e9ab1a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.677168] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 740.677519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.677814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.678142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.678427] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.678952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.679098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679395] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.680552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.681099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.681099] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.681347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.681347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.681579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.681667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.683274] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.852602] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fefe930-a078-492b-8eab-26e076c8e507: rpc.has_security_group_logging(os_id): False [ 740.871630] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.871785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.871856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.872166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.872270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.872493] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.872594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.872658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.872822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.872900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.873119] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.873226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.873289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.873441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.873518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.873704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.873796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.873858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.873998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.874174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.874263] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 740.952305] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.952570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.952570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.953578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.953578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.973347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 741.040993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 741.072306] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.072524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.072648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.073630] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.073630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.074045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.074045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.074045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.074181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.074262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.074531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.074616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.074667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.074825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.074900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.074986] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 741.152496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.152673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.152788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.152928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.153118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.182885] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 741.185368] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.185368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.185368] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.436295] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 in Status: SUCCESS [ 741.436486] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 256b6662-e079-48f2-8a9b-ddfdeb035f28 deletion is rescheduled due to dependency. [ 741.436609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-256b6662-e079-48f2-8a9b-ddfdeb035f28" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.688375] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.196348] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.196348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.196348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.196348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.196348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.196348] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 742.244173] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.245110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.245239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.245516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.245715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.259165] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 742.342316] env[65443]: INFO networking_nsxv3.common.synchronization [req-06186070-067c-4526-aaee-a451065cf34b req-a7db802c-ee6c-4757-91e1-14867f47a4af tempest-ServersTestFqdnHostnames-1972796060 tempest-ServersTestFqdnHostnames-1972796060-project-member] Enqueued Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 742.343424] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 with Priority: HIGHEST for action security_group_members [ 742.343984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.344167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.344996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.345290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.346132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.346335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.346445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.346731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.346856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.346992] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b8c4c8d-3b25-4427-a750-99a3dcc5e324',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.850824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.851234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.851234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.851303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.851382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.851582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.851683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.851752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.851908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.852428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.852581] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 is going to be updated. [ 742.868647] env[65443]: INFO networking_nsxv3.common.synchronization [req-40003280-334a-4a6f-ad35-dd8d19a118d1 req-e4bf21aa-7cba-4953-b168-a3aa3f3b88d6 tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 742.869179] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 742.869488] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.870564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.870684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.870898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.871075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.871183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.871246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.871396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.871482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.871604] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.884430] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.884594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.884651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.884834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.884985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.894507] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: IN_PROGRESS for 2s [ 742.988932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 742.989161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.989343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.989557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.989681] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.200441] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 743.201060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.375927] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.493962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.493962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.880074] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.272767] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.272767] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.272767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.272767] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.389022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.389022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.389022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.389022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.389022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.389022] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 744.417718] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.417873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.417927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.418150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.418299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.429356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 744.775174] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.910377] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 in Status: SUCCESS [ 744.911244] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b8c4c8d-3b25-4427-a750-99a3dcc5e324 deletion is rescheduled due to dependency. [ 744.911748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b8c4c8d-3b25-4427-a750-99a3dcc5e324" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.278550] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.782776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.783092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.783194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.783422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.783529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.783629] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 745.820330] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.820466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.820529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.820731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.820909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.833723] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 746.440098] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 746.440418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.440581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.440805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.440994] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.441125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.441190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.441439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.441568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.441724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.441861] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.944593] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.944844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.944925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.945183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.945412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.945620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.945620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.945820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.945918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.946090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.946274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.946396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.946513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.946609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.946794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.946892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.946954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.947135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.947215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.947298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.947402] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.449922] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fefe930-a078-492b-8eab-26e076c8e507: rpc.has_security_group_logging(os_id): False [ 747.470161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.470161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.470280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.470427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.470564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.470808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.470911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.470984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.471744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.471744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.472254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.472254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.472254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.472254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.472254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.472457] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 747.549672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.549672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.549672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.549672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.549672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.561366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 747.845607] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 747.845975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.846187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.846434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.847138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.847269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.848377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.848377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.848672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.848672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.848740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.848838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.848915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.849104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.849104] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.869599] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 747.869699] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 748.353338] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a21b1b0-a493-4718-8c01-ec2d54222333: rpc.has_security_group_logging(os_id): False [ 748.367051] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e785ed76-ac7e-4703-85d9-583c955b6ab4 None None] Enqueued Resource ID: b0bd216a-c88c-46f8-b82d-4576c80ca018 with Priority: HIGHEST for action port [ 748.367172] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0bd216a-c88c-46f8-b82d-4576c80ca018 with Priority: HIGHEST for action port [ 748.367737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0bd216a-c88c-46f8-b82d-4576c80ca018 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.367876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0bd216a-c88c-46f8-b82d-4576c80ca018" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.367919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0bd216a-c88c-46f8-b82d-4576c80ca018" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.369526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0bd216a-c88c-46f8-b82d-4576c80ca018" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.369526] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0bd216a-c88c-46f8-b82d-4576c80ca018',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.376487] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.376594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.376676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.376848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.376938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.377140] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.377231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.377289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.379206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.379206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.379206] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.379206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.379206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.379206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.380143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.380645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.380799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.380885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.381108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.381212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.381321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be created. [ 748.462941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.463388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.463388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.463458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.463681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.479227] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 748.873366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0bd216a-c88c-46f8-b82d-4576c80ca018 [ 748.873594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.873727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.873797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.874058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.874108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.874209] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0bd216a-c88c-46f8-b82d-4576c80ca018 already deleted. [ 748.874288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0bd216a-c88c-46f8-b82d-4576c80ca018" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.579066] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 749.579990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.496889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 750.497238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.497450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.497743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.497847] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.003044] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.003044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.003044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.003534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.003534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.003534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.003644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.003762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.003853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.003943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.004067] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.508453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.508643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.508700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.508920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.509168] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.509285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.509361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.509530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.509625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.509709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.509857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.509950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.510030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.510205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.510346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.510439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.510492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.510634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.510710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.510793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.510885] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.879322] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e193fbae-1514-4923-b159-39823c8edf85 None None] Enqueued Resource ID: f35ae52d-8f9e-4352-9aaa-31177e76a1be with Priority: HIGHEST for action port [ 751.882439] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f35ae52d-8f9e-4352-9aaa-31177e76a1be with Priority: HIGHEST for action port [ 751.883223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f35ae52d-8f9e-4352-9aaa-31177e76a1be taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.883439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f35ae52d-8f9e-4352-9aaa-31177e76a1be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.883514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f35ae52d-8f9e-4352-9aaa-31177e76a1be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.883767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f35ae52d-8f9e-4352-9aaa-31177e76a1be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.883869] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f35ae52d-8f9e-4352-9aaa-31177e76a1be',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.015696] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a21b1b0-a493-4718-8c01-ec2d54222333: rpc.has_security_group_logging(os_id): False [ 752.036296] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.037099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.037328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.037657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.037877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.040793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.040793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.040793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.040793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.040793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.042792] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.042792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.042792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.042792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.042792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.043087] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.043386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.043565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.043864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.044017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.044212] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 752.118053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.118274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.118435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.118648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.119095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.141068] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 752.388847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f35ae52d-8f9e-4352-9aaa-31177e76a1be [ 752.389108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.389233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.389304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.389559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.389615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.389699] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f35ae52d-8f9e-4352-9aaa-31177e76a1be already deleted. [ 752.389778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f35ae52d-8f9e-4352-9aaa-31177e76a1be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.868161] env[65443]: INFO networking_nsxv3.common.synchronization [req-156ac679-6eb9-4a36-8e59-fc976417a4af req-714eb39a-3646-4a15-a869-dd5f05897886 tempest-InstanceActionsTestJSON-449377544 tempest-InstanceActionsTestJSON-449377544-project-member] Enqueued Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 752.869028] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 752.870119] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.870119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.870119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.870119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.870119] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.870610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.870610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.870610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.870610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.870610] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.376983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.376983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.376983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.376983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.376983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.377454] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.377454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.377454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.377568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.377597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.378159] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 already deleted. [ 753.378159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.453455] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-642 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.453455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-642" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.455412] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-642" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.459023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-642" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.459023] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.459023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.459023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.459023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.459023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.459023] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.459023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.459023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.459023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.459023] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.459023] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.459023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.482757] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.482924] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.483083] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.483299] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-642" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.483675] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-71ebeee5-2e02-448d-b51e-b6ee42067faf taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.483912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.484077] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.484463] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.484645] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ebeee5-2e02-448d-b51e-b6ee42067faf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.988426] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.988426] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.988426] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.988426] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.988426] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.988426] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 71ebeee5-2e02-448d-b51e-b6ee42067faf not found, creating... [ 753.988426] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.989065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.989065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.989065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.989065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.989355] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.989568] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.989861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.990119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.990292] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.990437] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 71ebeee5-2e02-448d-b51e-b6ee42067faf is going to be created. [ 754.015961] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.015961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.015961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.015961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.015961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.016412] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.166149] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 754.166149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.877653] env[65443]: INFO networking_nsxv3.common.synchronization [req-156ac679-6eb9-4a36-8e59-fc976417a4af req-0326e804-241e-4d4a-b612-15adf40afc8d service nova] Enqueued Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_rules [ 754.877956] env[65443]: INFO networking_nsxv3.common.synchronization [req-156ac679-6eb9-4a36-8e59-fc976417a4af req-0326e804-241e-4d4a-b612-15adf40afc8d service nova] Enqueued Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 754.878026] env[65443]: INFO networking_nsxv3.common.synchronization [req-156ac679-6eb9-4a36-8e59-fc976417a4af req-0326e804-241e-4d4a-b612-15adf40afc8d service nova] Enqueued Resource ID: 71ebeee5-2e02-448d-b51e-b6ee42067faf with Priority: HIGHEST for action port [ 754.882024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_rules [ 754.882024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 754.882024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ebeee5-2e02-448d-b51e-b6ee42067faf with Priority: HIGHEST for action port [ 754.882024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.882024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.882024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.883526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.883526] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.883745] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.883745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.883892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.884023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.884239] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.884350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.884350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.884500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.884584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.884684] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.887130] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ebeee5-2e02-448d-b51e-b6ee42067faf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.887329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.887329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.887507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.887594] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ebeee5-2e02-448d-b51e-b6ee42067faf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.157930] env[65443]: INFO networking_nsxv3.common.synchronization [req-1ba887e2-283e-4b26-87b9-24122cb6c27f req-6b253409-96d5-446d-a5c5-406bbd601d9d tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 755.159632] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 755.160084] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.160230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.160311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.160474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.160646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.161269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.161269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.161460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.161460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.161561] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.392919] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.392919] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71ebeee5-2e02-448d-b51e-b6ee42067faf with status ACTIVE [ 755.392919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.392919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.392919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.393374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.393374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.393374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.393483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.393483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.394668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.394668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.394668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.394668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.394668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.399697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.399798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.399910] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71ebeee5-2e02-448d-b51e-b6ee42067faf is going to be updated. [ 755.401251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.401653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.427317] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.427697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.427962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.428237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.428429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.428802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ebeee5-2e02-448d-b51e-b6ee42067faf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.665559] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.893576] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.931578] env[65443]: INFO networking_nsxv3.common.synchronization [req-093856b5-eb69-40bc-9da2-233a2ecaaada req-ec07df36-b63c-491a-8878-428f87abdb6a tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 755.932350] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 755.932763] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.932934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.933050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.933346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.933571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.933721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.933825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.934068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.934209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.934364] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.074690] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b83d5a15-4e73-425c-b5d9-d6512370889a None None] Enqueued Resource ID: 051929d6-4966-4817-b86d-daa9702aa650 with Priority: HIGHEST for action port [ 756.075386] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 051929d6-4966-4817-b86d-daa9702aa650 with Priority: HIGHEST for action port [ 756.078095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-051929d6-4966-4817-b86d-daa9702aa650 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.078095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-051929d6-4966-4817-b86d-daa9702aa650" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.078095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-051929d6-4966-4817-b86d-daa9702aa650" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.078095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-051929d6-4966-4817-b86d-daa9702aa650" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.078095] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('051929d6-4966-4817-b86d-daa9702aa650',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.167456] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.361686] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7c540400-0742-44ef-baa1-a700d23bf41b None None] Enqueued Resource ID: 9ae5800b-c069-4df2-a554-59e3201776ee with Priority: HIGHEST for action port [ 756.361870] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ae5800b-c069-4df2-a554-59e3201776ee with Priority: HIGHEST for action port [ 756.362308] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ae5800b-c069-4df2-a554-59e3201776ee taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.362500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ae5800b-c069-4df2-a554-59e3201776ee" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.362549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ae5800b-c069-4df2-a554-59e3201776ee" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.363964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ae5800b-c069-4df2-a554-59e3201776ee" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.364167] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ae5800b-c069-4df2-a554-59e3201776ee',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.395903] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.396071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.396135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.396345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.396440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.396537] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 is going to be created. [ 756.427437] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.427620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.427658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.427855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.428027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.437689] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.442667] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: UNINITIALIZED for 2s [ 756.491791] env[65443]: INFO networking_nsxv3.common.synchronization [req-dd33d002-a1b1-4824-9b60-d17c18ea4d1b req-79bf834c-c7b6-46a8-9141-f3ffae654d7f tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 756.493193] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 756.493193] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.494255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.582338] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 051929d6-4966-4817-b86d-daa9702aa650 [ 756.582599] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.583194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.583194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.583194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.583194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.583360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:051929d6-4966-4817-b86d-daa9702aa650 already deleted. [ 756.583360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-051929d6-4966-4817-b86d-daa9702aa650" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.673647] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.673817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.673891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.674117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.674201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.674334] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 756.707904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.708081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.708158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.708376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.708518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.718377] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 756.868583] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ae5800b-c069-4df2-a554-59e3201776ee [ 756.868862] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.868993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.869095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.869309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.869443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.869549] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ae5800b-c069-4df2-a554-59e3201776ee already deleted. [ 756.869633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ae5800b-c069-4df2-a554-59e3201776ee" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.940765] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.443971] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.444253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.444253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.444448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.444599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.444708] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 757.483382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.483605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.483605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.484326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.484326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.498321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 758.455344] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: SUCCESS [ 758.455344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.455726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.455888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.456012] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.456107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.456183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.456448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.456448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.456538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.456600] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.731060] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 758.731287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.802836] env[65443]: INFO networking_nsxv3.common.synchronization [None req-cad71bc8-a570-4d26-9a50-54bae2196740 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 758.803892] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 758.804245] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.804394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.804562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.804896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.804959] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.921750] env[65443]: INFO networking_nsxv3.common.synchronization [None req-905c3963-a552-4090-8169-405a82719942 None None] Enqueued Resource ID: 8fb82f32-cb3b-432a-b7d4-aa35e31eceef with Priority: HIGHEST for action port [ 758.922659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fb82f32-cb3b-432a-b7d4-aa35e31eceef with Priority: HIGHEST for action port [ 758.923500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fb82f32-cb3b-432a-b7d4-aa35e31eceef taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.923500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fb82f32-cb3b-432a-b7d4-aa35e31eceef" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.923500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fb82f32-cb3b-432a-b7d4-aa35e31eceef" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.923500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fb82f32-cb3b-432a-b7d4-aa35e31eceef" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.923852] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fb82f32-cb3b-432a-b7d4-aa35e31eceef',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.958642] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.958877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.958925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.959199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.959392] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.959498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.959559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.959747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.959835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.959956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.960124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.960248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.960376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.960504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.960677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.960770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.960827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.961025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.961100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.961199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.961294] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.991874] env[65443]: INFO networking_nsxv3.common.synchronization [None req-36de54da-e271-4008-9b07-d8b3e2a0706c tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 758.993550] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 758.994635] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.994635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.128409] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b8333508-405c-4527-8b5a-56f20bfef1ef None None] Enqueued Resource ID: 0a162f5d-674c-4a44-8efe-6ee59275e126 with Priority: HIGHEST for action port [ 759.129777] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a162f5d-674c-4a44-8efe-6ee59275e126 with Priority: HIGHEST for action port [ 759.129979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a162f5d-674c-4a44-8efe-6ee59275e126 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.130152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a162f5d-674c-4a44-8efe-6ee59275e126" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.130321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a162f5d-674c-4a44-8efe-6ee59275e126" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.133121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a162f5d-674c-4a44-8efe-6ee59275e126" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.133121] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a162f5d-674c-4a44-8efe-6ee59275e126',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.339947] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.340129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.340210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.340455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.340549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.340643] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b already deleted. [ 759.340727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.340881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.341085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.341187] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.428479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8fb82f32-cb3b-432a-b7d4-aa35e31eceef [ 759.428479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.428479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.428479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.428479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.428479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.428479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8fb82f32-cb3b-432a-b7d4-aa35e31eceef already deleted. [ 759.428479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fb82f32-cb3b-432a-b7d4-aa35e31eceef" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.467270] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e141f38-80d1-407b-9da2-ec4d8adb3e99: rpc.has_security_group_logging(os_id): False [ 759.493208] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.493431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.493593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.494112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.494259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.494531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.494667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.494738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.494877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.494955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.495162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.495259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.495322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.495463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.495537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.495722] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.495816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.495879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.496059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.496139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.496351] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 is going to be created. [ 759.516699] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 759.516919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.517109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.517320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.517581] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.517710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.517776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.517941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.518041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.518140] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.592588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.592853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.592974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.593136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.593554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.606581] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: IN_PROGRESS for 2s [ 759.638037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a162f5d-674c-4a44-8efe-6ee59275e126 [ 759.638037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.638037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.638037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.638037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.638037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.638037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a162f5d-674c-4a44-8efe-6ee59275e126 already deleted. [ 759.638037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a162f5d-674c-4a44-8efe-6ee59275e126" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.870881] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.870881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.870881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.870881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.870881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.870881] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b already deleted. [ 759.870881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.021309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.021482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.021554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.026344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.026908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.029759] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.029759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.029759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.029759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.029759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.029759] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 760.104822] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.105012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.105096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.105353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.105515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.118296] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 761.619883] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: SUCCESS [ 761.620255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.130162] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 762.130375] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 deletion is rescheduled due to dependency. [ 762.130559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.791518] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e4f0505-adf3-4988-98cf-0eb632ff0355 req-9c677213-7aef-4784-b50c-c0c5a1216641 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 762.792991] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 762.792991] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.792991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.793200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.793397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.794029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.794029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.794029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.794214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.794548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.794548] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.298969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.299145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.303028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.303028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.303628] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 already deleted. [ 763.303628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.370048] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.370513] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.370513] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.371366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.371366] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.371366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.371366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.371615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.372095] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.372095] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.372095] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.372246] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.372332] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.372414] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.372542] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.372665] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.395980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.396495] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.396730] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.397046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.397851] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-aad3344f-9ff0-4849-a204-1b594a7e0983 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.397851] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.398020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.398663] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.402019] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad3344f-9ff0-4849-a204-1b594a7e0983',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.786442] env[65443]: INFO networking_nsxv3.common.synchronization [None req-dd4a9f9b-6e2c-46e9-b519-76359f3c7aa7 None None] Enqueued Resource ID: bbdf176a-864d-4d64-914a-7cc8867dd554 with Priority: HIGHEST for action port [ 763.786560] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbdf176a-864d-4d64-914a-7cc8867dd554 with Priority: HIGHEST for action port [ 763.787160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbdf176a-864d-4d64-914a-7cc8867dd554 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.787283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbdf176a-864d-4d64-914a-7cc8867dd554" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.787350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbdf176a-864d-4d64-914a-7cc8867dd554" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.787685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbdf176a-864d-4d64-914a-7cc8867dd554" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.787770] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbdf176a-864d-4d64-914a-7cc8867dd554',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.903176] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.906018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port aad3344f-9ff0-4849-a204-1b594a7e0983 not found, creating... [ 763.906018] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.906018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.906698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.907151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.907663] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.908073] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.910066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.910066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.910066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.910066] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: aad3344f-9ff0-4849-a204-1b594a7e0983 is going to be created. [ 763.933088] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.933349] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.933491] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.933896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.934025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.934283] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.290116] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbdf176a-864d-4d64-914a-7cc8867dd554 [ 764.292027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.292027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.292027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.292027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.292027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.292027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbdf176a-864d-4d64-914a-7cc8867dd554 already deleted. [ 764.292027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbdf176a-864d-4d64-914a-7cc8867dd554" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.705433] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e4f0505-adf3-4988-98cf-0eb632ff0355 req-d04a86dc-405f-4799-941e-ca94726cf476 service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 764.705631] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e4f0505-adf3-4988-98cf-0eb632ff0355 req-d04a86dc-405f-4799-941e-ca94726cf476 service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 764.705832] env[65443]: INFO networking_nsxv3.common.synchronization [req-3e4f0505-adf3-4988-98cf-0eb632ff0355 req-d04a86dc-405f-4799-941e-ca94726cf476 service nova] Enqueued Resource ID: aad3344f-9ff0-4849-a204-1b594a7e0983 with Priority: HIGHEST for action port [ 764.706551] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 764.706718] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 764.706832] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad3344f-9ff0-4849-a204-1b594a7e0983 with Priority: HIGHEST for action port [ 764.707209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.707448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.707531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.707779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.707873] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.711516] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.711516] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.711516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.711516] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.714490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad3344f-9ff0-4849-a204-1b594a7e0983 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.714490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.714490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.714490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.714490] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad3344f-9ff0-4849-a204-1b594a7e0983',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.215293] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.216415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.216587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.216733] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aad3344f-9ff0-4849-a204-1b594a7e0983 with status ACTIVE [ 765.216870] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.216983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.217139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.217320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.217450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.217617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.217703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.217753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.217885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.217980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.219459] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.219740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.219740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.219911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.220039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.220123] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aad3344f-9ff0-4849-a204-1b594a7e0983 is going to be updated. [ 765.245838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.246130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.246130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.246489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.246649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.246900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad3344f-9ff0-4849-a204-1b594a7e0983" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.704969] env[65443]: INFO networking_nsxv3.common.synchronization [req-b7dd8389-1bae-41a0-8aa9-0eb6baf5a66d req-4a898e3d-5ba4-44f4-bf5f-74fbde7c6549 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 765.704969] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 765.704969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.705189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.705189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.705438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.706050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.706050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.706050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.706050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.706050] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.723771] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.110059] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3a1e71d6-7f61-4f66-90b5-fe8c56b5f6f1 None None] Enqueued Resource ID: ca936a6c-0314-4b32-82c9-87d375374263 with Priority: HIGHEST for action port [ 766.110340] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca936a6c-0314-4b32-82c9-87d375374263 with Priority: HIGHEST for action port [ 766.110940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca936a6c-0314-4b32-82c9-87d375374263 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.111294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca936a6c-0314-4b32-82c9-87d375374263" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.111294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca936a6c-0314-4b32-82c9-87d375374263" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.111642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca936a6c-0314-4b32-82c9-87d375374263" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.111745] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca936a6c-0314-4b32-82c9-87d375374263',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.133882] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.133882] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.133882] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.133882] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.134945] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.134945] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.135086] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.135334] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.135441] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.135813] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.135813] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 766.135813] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 766.135949] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 766.135980] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 766.136279] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 766.136279] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 766.158030] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 766.158269] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 766.158410] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 766.158776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.159495] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.159855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.159943] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.160765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.161044] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d9aa0d4-1aaa-47ed-9837-07a9a110d05d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.209864] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.209864] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.209864] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 already deleted. [ 766.209864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.227043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.227444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.227444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.228098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.228098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.228235] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 766.256024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.256260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.256260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.256479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.256642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.268900] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: UNINITIALIZED for 2s [ 766.616027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca936a6c-0314-4b32-82c9-87d375374263 [ 766.616027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.616027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.616027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.616027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.616027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.616027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca936a6c-0314-4b32-82c9-87d375374263 already deleted. [ 766.616027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca936a6c-0314-4b32-82c9-87d375374263" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.667026] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.667026] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d not found, creating... [ 766.667026] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.667026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.667517] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.667517] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.667585] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.667703] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.668019] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.668232] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.668356] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.668485] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d is going to be created. [ 766.690831] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.690831] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.690831] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.690995] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.691094] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.691315] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.014456] env[65443]: INFO networking_nsxv3.common.synchronization [None req-87628946-c873-4873-9ee0-5becf89d3091 None None] Enqueued Resource ID: d96b5fa0-697d-4e97-bec3-5a3887fe9222 with Priority: HIGHEST for action port [ 767.014623] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96b5fa0-697d-4e97-bec3-5a3887fe9222 with Priority: HIGHEST for action port [ 767.015816] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d96b5fa0-697d-4e97-bec3-5a3887fe9222 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.015816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d96b5fa0-697d-4e97-bec3-5a3887fe9222" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.015816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d96b5fa0-697d-4e97-bec3-5a3887fe9222" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.016161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d96b5fa0-697d-4e97-bec3-5a3887fe9222" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.016161] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d96b5fa0-697d-4e97-bec3-5a3887fe9222',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.419097] env[65443]: INFO networking_nsxv3.common.synchronization [req-b7dd8389-1bae-41a0-8aa9-0eb6baf5a66d req-c7d2fe08-ecaa-4ee7-88ff-3a66d3f36c1a service nova] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 767.419097] env[65443]: INFO networking_nsxv3.common.synchronization [req-b7dd8389-1bae-41a0-8aa9-0eb6baf5a66d req-c7d2fe08-ecaa-4ee7-88ff-3a66d3f36c1a service nova] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 767.419305] env[65443]: INFO networking_nsxv3.common.synchronization [req-b7dd8389-1bae-41a0-8aa9-0eb6baf5a66d req-c7d2fe08-ecaa-4ee7-88ff-3a66d3f36c1a service nova] Enqueued Resource ID: 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d with Priority: HIGHEST for action port [ 767.420056] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 767.420056] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 767.420296] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d with Priority: HIGHEST for action port [ 767.420685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.420904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.421024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.421291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.421381] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.422902] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.423130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.423201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.423422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.423652] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.423798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.423889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.425300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.425300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.425300] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.426114] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.426114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.426114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.426114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.426114] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d9aa0d4-1aaa-47ed-9837-07a9a110d05d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.518233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d96b5fa0-697d-4e97-bec3-5a3887fe9222 [ 767.518514] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.518652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.518718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.518921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.519019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.519114] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d96b5fa0-697d-4e97-bec3-5a3887fe9222 already deleted. [ 767.519355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d96b5fa0-697d-4e97-bec3-5a3887fe9222" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.608282] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:0 completed [ 767.608282] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:1 started [ 767.927904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.928037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.928232] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.929496] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d with status ACTIVE [ 767.929687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.929802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.929869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.930084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.930174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.930346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.930443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.930503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.930655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.930820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.930893] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.930985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.931647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.931863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.932064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.932170] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d9aa0d4-1aaa-47ed-9837-07a9a110d05d is going to be updated. [ 767.960382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.960382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.960382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.960382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.960594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.960697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d9aa0d4-1aaa-47ed-9837-07a9a110d05d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.283094] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.283094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.283094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.283094] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.435050] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.787803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.787803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.787803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.788139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.788139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.788297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.788360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.788512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.788641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.788720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.788895] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.789051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.789051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.789178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.789416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.789416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.789603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.789603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.789697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.789741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.789845] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.937125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.937290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.937365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.937580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.937673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.937769] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be created. [ 768.964038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.964235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.964235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.964358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.965843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.975762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: UNINITIALIZED for 2s [ 769.291907] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d34e09-75e3-43fa-8d8c-5bb269633d94: rpc.has_security_group_logging(os_id): False [ 769.318928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.319150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.320831] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.320831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.321178] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.321178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.321250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.321420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.321473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.321706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.322221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.322221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.322221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.322221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.322481] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 769.404509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.404509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.404509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.404716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.404916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.419211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 770.680386] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0d6d1bd6-1f5c-40aa-bfce-ef27083ba5e9 None None] Enqueued Resource ID: 72e1659c-067c-40a1-bbfd-cbff47509fdc with Priority: HIGHEST for action port [ 770.680386] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72e1659c-067c-40a1-bbfd-cbff47509fdc with Priority: HIGHEST for action port [ 770.680386] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-72e1659c-067c-40a1-bbfd-cbff47509fdc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.680760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72e1659c-067c-40a1-bbfd-cbff47509fdc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.680760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72e1659c-067c-40a1-bbfd-cbff47509fdc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.681074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72e1659c-067c-40a1-bbfd-cbff47509fdc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.681160] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72e1659c-067c-40a1-bbfd-cbff47509fdc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.991026] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 770.991247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.991464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.991683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.991873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.991988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.992065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.992220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.992337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.992457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.992508] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.113644] env[65443]: INFO networking_nsxv3.common.synchronization [req-7e6ff493-3c00-4160-9cf2-b05000b6938c req-c1e60916-097f-41f8-b435-c813264f708f tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 771.113644] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 771.115020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.117691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.117691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.117691] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.183012] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72e1659c-067c-40a1-bbfd-cbff47509fdc [ 771.183911] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.183911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.183911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.184122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.184249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.184366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72e1659c-067c-40a1-bbfd-cbff47509fdc already deleted. [ 771.184448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72e1659c-067c-40a1-bbfd-cbff47509fdc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.436485] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 771.437100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.499538] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.619896] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.620102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.620185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.620394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.620748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.620748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.620937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.620937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.621030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.622029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.622029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 771.659279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.659533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.659533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.659695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.659827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.671142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 772.003247] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f2dbdb-92d8-4566-bb7c-8c740d6edde6: rpc.has_security_group_logging(os_id): False [ 772.024779] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.024779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.024779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.025404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.025404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.025404] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.025404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.025843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.025843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.025843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.025843] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be created. [ 772.110269] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.110269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.110269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.110526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.110526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.124265] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 773.681904] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 773.682253] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 773.682253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.842114] env[65443]: INFO networking_nsxv3.common.synchronization [req-aee98793-cfda-4eb0-b333-a36b0807648d req-86350db4-66ca-43e8-bea9-e83c9dd66abf tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 773.842694] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 773.842997] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.843977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.844252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.844308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.844434] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.844537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.844653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.844752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.845475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.845475] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.136607] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 774.136734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.266962] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-786 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.267354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.267488] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.267865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.268246] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.268442] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.268588] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.268856] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.269039] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.269306] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.269491] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.269698] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.269879] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.270045] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.270216] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.270405] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.291903] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.292104] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.292245] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.292457] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-786" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.292796] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-a3bbf70c-2341-4b10-a055-e6e585399a78 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.292969] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.293105] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.293456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.293641] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3bbf70c-2341-4b10-a055-e6e585399a78',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.347671] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.796192] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.796723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.796888] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.797208] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.797429] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.797654] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port a3bbf70c-2341-4b10-a055-e6e585399a78 not found, creating... [ 774.797942] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.798112] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.798231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.798481] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.798623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.798991] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.801203] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.801345] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.801544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.801740] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.801890] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: a3bbf70c-2341-4b10-a055-e6e585399a78 is going to be created. [ 774.826558] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.826809] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.826993] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.827285] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.827577] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.827863] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.849777] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.352189] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.352423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.352544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.352834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.352927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.353127] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be updated. [ 775.396458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.396691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.396747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.397747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.397747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.410423] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 775.625927] env[65443]: INFO networking_nsxv3.common.synchronization [req-aee98793-cfda-4eb0-b333-a36b0807648d req-5ee2a775-9932-4c89-89f4-8cce54403155 service nova] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_rules [ 775.626252] env[65443]: INFO networking_nsxv3.common.synchronization [req-aee98793-cfda-4eb0-b333-a36b0807648d req-5ee2a775-9932-4c89-89f4-8cce54403155 service nova] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 775.626252] env[65443]: INFO networking_nsxv3.common.synchronization [req-aee98793-cfda-4eb0-b333-a36b0807648d req-5ee2a775-9932-4c89-89f4-8cce54403155 service nova] Enqueued Resource ID: a3bbf70c-2341-4b10-a055-e6e585399a78 with Priority: HIGHEST for action port [ 775.627047] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_rules [ 775.627047] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 775.628129] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3bbf70c-2341-4b10-a055-e6e585399a78 with Priority: HIGHEST for action port [ 775.628247] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.628423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.628423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.628692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.629290] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.629795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.629879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.630069] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3bbf70c-2341-4b10-a055-e6e585399a78 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.630144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.630192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.630426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.630528] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3bbf70c-2341-4b10-a055-e6e585399a78',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.062083] env[65443]: INFO networking_nsxv3.common.synchronization [req-35e780dd-baf9-488a-890b-72bcf82f51a0 req-c34ec83a-9800-401f-a2c2-1d89f639c6a4 tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 776.064662] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 776.064662] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.064662] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.064662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.065017] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.113101] env[65443]: INFO networking_nsxv3.common.synchronization [None req-82daee4b-9055-488a-b149-c4055351ae02 None None] Enqueued Resource ID: a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf with Priority: HIGHEST for action port [ 776.113649] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf with Priority: HIGHEST for action port [ 776.114090] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.114194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.114194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.114829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.114829] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.136380] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.136581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.136697] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3bbf70c-2341-4b10-a055-e6e585399a78 with status ACTIVE [ 776.136871] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.136948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.136981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.137433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.137433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.137433] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.137871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.137871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.137871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.137871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.138028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.138275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.138275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.138393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.138393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.138498] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3bbf70c-2341-4b10-a055-e6e585399a78 is going to be updated. [ 776.164273] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.164613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.164613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.164712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.165022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.165111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3bbf70c-2341-4b10-a055-e6e585399a78" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.568663] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.616436] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf [ 776.616436] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.616616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.616616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.616885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.616885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.617048] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf already deleted. [ 776.617578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a87ba0fa-92eb-4ee7-8fca-50aff98ebbcf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.742322] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c01a16b-ca1a-4c78-a24e-9741e6e542c4 req-f4f64eb0-8dee-45c6-8bf1-28ef4b565894 tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 776.743452] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 776.743876] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.744040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.744176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.744417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.744594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.744695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.744786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.744979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.745050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.745146] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.070935] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.180215] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.180533] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.180673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.180931] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.183682] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.183862] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.183981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.184270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.184754] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.184754] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.184754] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.184938] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.184938] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.185041] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.185132] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.185262] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.216027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.216027] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.216027] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.216027] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.216027] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-1bf32a83-dd27-4289-b618-28320ebe3e38 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.216027] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.216027] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.216027] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.216027] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf32a83-dd27-4289-b618-28320ebe3e38',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.247369] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.247597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.247672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.250551] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.250551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.250551] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 777.294387] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.294593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.294640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.294867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.295187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.314494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 777.427344] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 777.427645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.427952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.428240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.428449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.428558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.428626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.428804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.428895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.428996] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.573953] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.574159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.574234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.574478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.574591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.574832] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 777.610635] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.610797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.610937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.624693] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 777.720790] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.722229] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.722466] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.722680] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.722850] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.722979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 1bf32a83-dd27-4289-b618-28320ebe3e38 not found, creating... [ 777.723277] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.723440] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.723902] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.727446] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.727446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.727739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 1bf32a83-dd27-4289-b618-28320ebe3e38 is going to be created. [ 777.758505] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.758747] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.758848] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.759133] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.759353] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.759572] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.932565] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.434785] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.502782] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c01a16b-ca1a-4c78-a24e-9741e6e542c4 req-51b25d31-2537-40ae-bb27-a225d6367874 service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 778.502972] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c01a16b-ca1a-4c78-a24e-9741e6e542c4 req-51b25d31-2537-40ae-bb27-a225d6367874 service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 778.503217] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c01a16b-ca1a-4c78-a24e-9741e6e542c4 req-51b25d31-2537-40ae-bb27-a225d6367874 service nova] Enqueued Resource ID: 1bf32a83-dd27-4289-b618-28320ebe3e38 with Priority: HIGHEST for action port [ 778.503932] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 778.504101] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 778.504225] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bf32a83-dd27-4289-b618-28320ebe3e38 with Priority: HIGHEST for action port [ 778.506943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.506943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.506943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.506943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.506943] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.506943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.506943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.507510] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bf32a83-dd27-4289-b618-28320ebe3e38 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.507510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.507510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.507510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.507644] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bf32a83-dd27-4289-b618-28320ebe3e38',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.728475] env[65443]: INFO networking_nsxv3.common.synchronization [None req-42ce7c78-b34a-46d9-a508-4bed22fcbc9e None None] Enqueued Resource ID: 833a2922-5cbf-4e61-96ef-794067a52a7c with Priority: HIGHEST for action port [ 778.729080] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 833a2922-5cbf-4e61-96ef-794067a52a7c with Priority: HIGHEST for action port [ 778.729582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-833a2922-5cbf-4e61-96ef-794067a52a7c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.729582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-833a2922-5cbf-4e61-96ef-794067a52a7c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.729669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-833a2922-5cbf-4e61-96ef-794067a52a7c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.730093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-833a2922-5cbf-4e61-96ef-794067a52a7c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.730301] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('833a2922-5cbf-4e61-96ef-794067a52a7c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.938141] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.938274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.938358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.938560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.938652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.938762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be updated. [ 778.975371] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.975557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.975557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.975783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.975921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.985774] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 779.014361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.014361] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bf32a83-dd27-4289-b618-28320ebe3e38 with status ACTIVE [ 779.014361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.014361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.014361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.014361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.015101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.015101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.015101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.015101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.015101] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bf32a83-dd27-4289-b618-28320ebe3e38 is going to be updated. [ 779.039246] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.039399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.039477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.039671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.039806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.039967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bf32a83-dd27-4289-b618-28320ebe3e38" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.233113] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 833a2922-5cbf-4e61-96ef-794067a52a7c [ 779.233723] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.234010] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.234207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.234514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.234655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.234835] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:833a2922-5cbf-4e61-96ef-794067a52a7c already deleted. [ 779.234988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-833a2922-5cbf-4e61-96ef-794067a52a7c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.326524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 779.326731] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e deletion is rescheduled due to dependency. [ 779.326866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.327084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.327328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.327641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.327759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.327857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.328042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.328140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.328240] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.637346] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 779.637738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.831047] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.853479] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d41bbe5-de36-428f-8457-b4a8b65ab3c4 req-1e25800a-0416-4692-af22-e21fb99616b9 tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 779.856379] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 779.857161] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.857893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.857893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.857893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.858050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.858172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.858235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.858432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.858576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.858613] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.316849] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.317241] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.317485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.318381] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.318381] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.318600] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.318810] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.319187] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.319431] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.319789] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.319976] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.320161] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.320356] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.320543] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.320803] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.320936] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.333702] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.344119] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.344119] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.344360] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.344360] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-300" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.345043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.346410] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.346622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.347107] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.347254] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.361340] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.362055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.362183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.362544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.362644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.362904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.363110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.363145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.363295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.363395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.363532] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 780.435091] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.435376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.435512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.435848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.436124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.454076] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 780.838757] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.839157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.839157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.839397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.839524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.839661] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 780.851747] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.852041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.852222] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.852536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.852685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.852837] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 not found, creating... [ 780.853129] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.853301] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.853407] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.853641] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.853766] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.854099] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.854255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.854364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.854575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.854703] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.854830] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 is going to be created. [ 780.878379] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.878594] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.878705] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.878974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.879266] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.879495] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.881821] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.882040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.882239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.882518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.884074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.893802] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 781.003608] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.003608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.003608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.003608] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.507772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.507918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.507955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.508190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.509408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.509408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.509408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.509840] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.509840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.509840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.509840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.509990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.509990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.510947] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.618052] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d41bbe5-de36-428f-8457-b4a8b65ab3c4 req-d37fd709-5126-438a-bc9a-2ff9d95cc305 service nova] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 781.618052] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d41bbe5-de36-428f-8457-b4a8b65ab3c4 req-d37fd709-5126-438a-bc9a-2ff9d95cc305 service nova] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 781.618052] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d41bbe5-de36-428f-8457-b4a8b65ab3c4 req-d37fd709-5126-438a-bc9a-2ff9d95cc305 service nova] Enqueued Resource ID: f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 with Priority: HIGHEST for action port [ 781.618052] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_rules [ 781.618052] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 781.619291] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 with Priority: HIGHEST for action port [ 781.619800] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.620094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.620341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.620807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.621014] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.623123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.623225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.623434] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.623557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.625300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.625300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.625300] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.860093] env[65443]: INFO networking_nsxv3.common.synchronization [req-487737f4-3f14-4c2e-bf94-992a4369609c req-f2369f55-c901-4250-9d68-68ef62658277 tempest-InstanceActionsTestJSON-449377544 tempest-InstanceActionsTestJSON-449377544-project-member] Enqueued Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 781.860954] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGHEST for action security_group_members [ 781.861490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.861490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.861743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.861743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.861941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.861994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.862081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.862175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.862258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.862351] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.012969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81bf2cab-4b9a-41ce-82f6-260bedede9ec: rpc.has_security_group_logging(os_id): False [ 782.036567] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.036567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.036567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.036567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.036567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.036874] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.036874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.036874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.036982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.038699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.038699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.038699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.042661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.043335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.043514] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be updated. [ 782.122876] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.123092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.123092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.123310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.123502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.125622] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.125903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.125994] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 with status ACTIVE [ 782.126274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.126480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.126534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.127073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.127073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.127409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.127409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.127409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.127590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.127675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.127917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.128167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.129709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.129709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.129709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.129709] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6 is going to be updated. [ 782.144800] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 782.157589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.157589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.157589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.157589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.157589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.157589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f29644d0-84ba-48f8-bdf3-a1bd95d5a6b6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.364469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.364604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.364604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.364828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.364926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.365225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.365302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.365339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.365478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.365555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.365644] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 is going to be updated. [ 782.430672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.430672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.430672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.430672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.430672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.450901] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: IN_PROGRESS for 2s [ 782.471419] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 782.471419] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 deletion is rescheduled due to dependency. [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.471419] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.471419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.471419] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.904962] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 782.905374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.905777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.905997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.906205] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.906327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.906396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.906583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.906629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.906738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.906832] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.976183] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.410316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.410316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.410316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.410316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.410316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.410316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.410761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.410761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.410761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.410761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.410891] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.410939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.411085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.411142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.411272] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.411358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.411426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.411556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.411653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.411699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.411784] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.479715] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.917961] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1004a68b-2190-4689-9601-8db71d48978e: rpc.has_security_group_logging(os_id): False [ 783.937490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.937628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.937698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.937901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.937991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.938557] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.938557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.938557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.938557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.938557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.938785] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.938830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.938991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.939060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.939195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.939335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.939524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.939524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.939662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.939732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.939813] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 783.986431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.986431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.986431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.986431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.986431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.986431] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 784.019362] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.019362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.019362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.019362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.019362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.035804] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 784.036994] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.037134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.037224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.038082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.038082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.051841] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 784.157980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 784.158394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.463988] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 in Status: SUCCESS [ 784.464195] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 deletion is rescheduled due to dependency. [ 784.464195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.052481] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 786.052481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.061353] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 786.061580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.061881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.062170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.062316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.062533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.062533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.062733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.062862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.062984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.063137] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.568572] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.862019] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 786.862220] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 787.070920] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 338befad-e097-41dd-903a-b87985d12b22: rpc.has_security_group_logging(os_id): False [ 787.090077] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.090639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.090639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.090639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.090639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.092274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.092274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.092274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.092274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.092274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.092274] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 787.154627] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.155091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.155091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.155239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.155361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.172123] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 787.296446] env[65443]: INFO networking_nsxv3.common.synchronization [req-2f9c810c-99fc-4d71-82c3-48f386cb360b req-e884ddb5-e896-45bb-a010-55f95712c9c5 tempest-ListImageFiltersTestJSON-1965178563 tempest-ListImageFiltersTestJSON-1965178563-project-member] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 787.297347] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 787.297803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.297976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.298200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.298456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.298631] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.298770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.298857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.299185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.299263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.300431] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.801690] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.293240] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d696a70-677b-4b4d-a744-e3565907474b req-599e51b1-26b9-48ff-8860-71b376c67aa8 tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 788.293947] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 788.294277] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.294460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.294559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.294796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.295045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.295202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.295294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.295488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.295605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.295728] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.304033] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.798751] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.805809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.807396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.807396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.807396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.807396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.807396] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be updated. [ 788.837721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.837721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.837721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.837721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.838402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.847653] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 789.188729] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 789.188961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.301636] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.807670] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.807670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.807670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807670] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 789.839209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.839209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.839209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.839209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.839507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.850388] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 790.138037] env[65443]: INFO networking_nsxv3.common.synchronization [req-ec2edabf-7dd5-4e94-9b7e-bb5173be5159 req-923c2618-5506-4dbc-bd9e-aeee71bff772 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 790.138516] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 790.139125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.139512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.139593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.139875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.140074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.140182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.140244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.140449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.140564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.140668] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.646089] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.646485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.646485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.646485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.646599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.646753] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.646850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.646917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.647075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.647150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.647233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 already deleted. [ 790.647311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.739536] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.739536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-839" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.739536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-839" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.739536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-839" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.739890] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.740319] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.741542] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.741542] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.741542] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.741542] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.741542] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.741542] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.741764] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.741881] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.742086] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.742309] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.764136] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.765993] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.766290] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.766512] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-839" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.767050] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d72bf01a-5833-4162-b116-b877d61fef79 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.767184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.767229] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.767543] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.767677] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72bf01a-5833-4162-b116-b877d61fef79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.859089] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 790.861431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.269673] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.269968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.270126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.270732] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.270806] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.270925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d72bf01a-5833-4162-b116-b877d61fef79 not found, creating... [ 791.271315] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.271695] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.271695] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.271799] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.271914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.272202] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.272346] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.272483] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.272689] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.272812] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.272942] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d72bf01a-5833-4162-b116-b877d61fef79 is going to be created. [ 791.297988] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.298236] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.298523] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.298665] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.298890] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.299468] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.556692] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.556692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.556692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.556692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.556692] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.864591] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 791.864885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.058402] env[65443]: INFO networking_nsxv3.common.synchronization [req-ec2edabf-7dd5-4e94-9b7e-bb5173be5159 req-edce88c9-a712-4590-96d6-09e374131e3e service nova] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 792.058509] env[65443]: INFO networking_nsxv3.common.synchronization [req-ec2edabf-7dd5-4e94-9b7e-bb5173be5159 req-edce88c9-a712-4590-96d6-09e374131e3e service nova] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 792.059214] env[65443]: INFO networking_nsxv3.common.synchronization [req-ec2edabf-7dd5-4e94-9b7e-bb5173be5159 req-edce88c9-a712-4590-96d6-09e374131e3e service nova] Enqueued Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 792.059214] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.060610] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 792.060906] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 792.061162] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 792.062288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.062525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.062618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.062833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.062940] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.064126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.064285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.064410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.064627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.064804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.064950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.064950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.065200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.065288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.065386] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.066917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72bf01a-5833-4162-b116-b877d61fef79 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.067140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.067140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.067308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.067640] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72bf01a-5833-4162-b116-b877d61fef79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.562513] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.570293] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.570293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.570293] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.571165] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d72bf01a-5833-4162-b116-b877d61fef79 with status ACTIVE [ 792.571235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.572363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.572363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.572363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.572363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.572363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.572701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.572701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.573401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.573767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.573849] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.574294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.574294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.574294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.574294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.574442] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d72bf01a-5833-4162-b116-b877d61fef79 is going to be updated. [ 792.598383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.598528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.598593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.598798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.598935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.599148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.066086] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 793.068227] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 793.076321] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.267505] env[65443]: INFO networking_nsxv3.common.synchronization [req-d18c615d-3506-431d-b90b-a0f46ab8d6b0 req-4013fc04-dc28-416d-ab6e-0f4ff3405ef5 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 793.268627] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 793.269162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.269429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.271092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.271481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.271825] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.272064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.272417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.273316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.273528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.273908] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.579993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.580199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.580270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.580524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.580605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.580723] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be created. [ 793.609926] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.609926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.610439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.610439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.610439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.623085] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: UNINITIALIZED for 2s [ 793.777640] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.777640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.777640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.777640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.777908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.777908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.777998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.778141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.778371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.778371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.778371] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 793.833479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.833654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.833697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.833923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.834064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.845647] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 793.980044] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.980044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.980044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.980044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.996232] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 793.997063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.997881] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 794.032337] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.032337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.032337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.032612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.039444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.040017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 794.040217] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 794.040217] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 794.077792] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.078139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.078139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.079912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.081427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.081552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 794.151993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.154646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.154871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.155743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.156128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.156514] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 794.236614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.236614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.236614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.236848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.237836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.237836] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 794.237836] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'0b1f6c30-ca79-4905-ab9e-12a9c0b30bad', 'f9c98539-6490-4aa2-80d1-381c6299bd04', 'b1d34e09-75e3-43fa-8d8c-5bb269633d94', 'bf29a740-117d-4608-9ae8-3ea4e2f6be2e', '338befad-e097-41dd-903a-b87985d12b22', 'e33573b4-6e20-4958-b534-744277031b44', '0fe6210d-3498-4e0f-b810-00e0478f00cb', 'ca2c637c-a7f1-415d-b0a1-fc76f318aea5', '8e1792da-b313-46fc-bec2-ab5ddb70bee3', 'd7ca5770-a687-4792-9de6-c002c902a32a', '8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc', '122d9a8c-f3eb-4ca9-8647-bd1e39de46b9', '5fc7c7e4-ccff-4f6f-b071-841331d702a0', '21f2dbdb-92d8-4566-bb7c-8c740d6edde6', '01849c7a-29c1-4280-be13-1fa17a01cb17', '4fefe930-a078-492b-8eab-26e076c8e507', '7e141f38-80d1-407b-9da2-ec4d8adb3e99', '8a21b1b0-a493-4718-8c01-ec2d54222333', 'd41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f', 'ded103e4-c215-45f9-85d6-afc52b8ad0ec', '23540878-f6a1-4e06-86e4-4e60026efbeb', '256b6662-e079-48f2-8a9b-ddfdeb035f28', '08bead38-748c-49c3-9386-219294620db2', '3a44c9a5-6f34-40e8-bb18-8fd3522bbccf', '81bf2cab-4b9a-41ce-82f6-260bedede9ec', 'ca7259b9-1e79-42d6-87f5-2acdaf792fd0', '32d4eeb4-d8a1-4a19-a639-e9bb163080a5', '9b8c4c8d-3b25-4427-a750-99a3dcc5e324', 'a8408b2f-592c-45ed-bf39-d0ac93e874f2', '1004a68b-2190-4689-9601-8db71d48978e', '7c113e23-4653-415c-8339-d252037cc64b', 'eb18cd6e-092e-4f1e-972b-3476700e4c4d', '373eadf5-9140-4fc8-8636-38b8598454fa'} {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 794.237836] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 794.264876] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.265079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.265140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.266075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.266075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.266075] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 794.266075] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 794.266075] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 794.396333] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.396574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.396757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.397448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.397774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.398056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 794.399135] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 794.399135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 794.399135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 794.399135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGH for action security_group_rules [ 794.399135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGH for action security_group_rules [ 794.399659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGH for action security_group_rules [ 794.399659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGH for action security_group_rules [ 794.399659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGH for action security_group_rules [ 794.399659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGH for action security_group_rules [ 794.399785] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGH for action security_group_rules [ 794.400248] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGH for action security_group_rules [ 794.400248] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGH for action security_group_rules [ 794.400248] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGH for action security_group_rules [ 794.400248] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGH for action security_group_rules [ 794.400248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.637541] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 795.637911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.637974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.638240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.638458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.638623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.638749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.638980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.639137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.639357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.639451] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.871033] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 795.871271] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 795.871405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.893433] env[65443]: INFO networking_nsxv3.common.synchronization [req-3f419daa-2f79-4e11-8ac6-c1af22bed974 req-19a9c6ed-6adc-4233-a9fd-4afa6ca738a1 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 795.894196] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 795.894633] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad with Priority: HIGH for action security_group_rules [ 795.894862] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 795.895297] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb with Priority: HIGH for action security_group_rules [ 795.895297] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 with Priority: HIGH for action security_group_rules [ 795.895297] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGH for action security_group_rules [ 795.895462] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGH for action security_group_rules [ 795.895673] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGH for action security_group_rules [ 795.895749] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 with Priority: HIGH for action security_group_rules [ 795.895848] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGH for action security_group_rules [ 795.895971] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGH for action security_group_rules [ 795.896085] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 with Priority: HIGH for action security_group_rules [ 795.896197] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGH for action security_group_rules [ 795.896268] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGH for action security_group_rules [ 795.896359] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGH for action security_group_rules [ 795.896613] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 with Priority: HIGH for action security_group_rules [ 795.897821] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33573b4-6e20-4958-b534-744277031b44 with Priority: HIGH for action security_group_rules [ 795.897821] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGH for action security_group_rules [ 795.898214] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGH for action security_group_rules [ 795.898404] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9c98539-6490-4aa2-80d1-381c6299bd04 with Priority: HIGH for action security_group_rules [ 795.898479] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 795.898899] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.899323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.899590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.900231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.900455] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.901137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.901137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.901137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.901137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.901137] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.904116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.904116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.904256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.904480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.904574] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b1f6c30-ca79-4905-ab9e-12a9c0b30bad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.905651] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.905762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.905839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.906175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.906274] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.907358] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0fe6210d-3498-4e0f-b810-00e0478f00cb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.907705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.907705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.907705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.907832] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0fe6210d-3498-4e0f-b810-00e0478f00cb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.909279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01849c7a-29c1-4280-be13-1fa17a01cb17 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.909279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.909279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.909438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.909471] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01849c7a-29c1-4280-be13-1fa17a01cb17',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.910507] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.910749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.910837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.910988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.911137] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.912094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.912236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.912306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.912460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.912569] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.913661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.913983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.914108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.914282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.914486] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.915375] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.915558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.915653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.915830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.915928] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e141f38-80d1-407b-9da2-ec4d8adb3e99',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.917284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.917284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.917284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.917284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.917495] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.917884] env[65443]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 795.919312] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.919312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.919312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.919312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.919312] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.920756] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.920756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.920756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.920756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.920756] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5fc7c7e4-ccff-4f6f-b071-841331d702a0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.922319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.922319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.922319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.922319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.922319] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.923450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.923450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.923450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.923743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.923888] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.925702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.925702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.925702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.925702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.925924] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.926949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.926949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.926949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.927116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.927385] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e1792da-b313-46fc-bec2-ab5ddb70bee3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.928019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33573b4-6e20-4958-b534-744277031b44 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.928165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.928244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.928412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.928523] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33573b4-6e20-4958-b534-744277031b44',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.929339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.929504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.929595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.929767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.929842] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.930806] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.931015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.931117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.931287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.931382] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.932215] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9c98539-6490-4aa2-80d1-381c6299bd04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.932366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.932456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.932645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.932759] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9c98539-6490-4aa2-80d1-381c6299bd04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.933000] env[65443]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 795.933725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.933864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.933952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.934214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.934290] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.143109] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.333312] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-205 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.333509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.333631] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.333892] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.334149] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.334300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.334412] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.334615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.334752] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.334980] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.335104] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 796.335171] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 796.335273] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 796.335376] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 796.335479] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 796.335602] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 796.354420] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 796.354762] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 796.354842] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 796.355415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-205" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.355415] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-500e0eca-31c3-465b-97fc-c9eace117acf taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.355827] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.355827] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.356132] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.356303] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500e0eca-31c3-465b-97fc-c9eace117acf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.438944] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.461762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.461762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.461762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.461762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.465970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.465970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.469772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.469772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.469772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.469772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.469772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.469772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.470155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.470381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.470520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.470654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.470787] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.472605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.472605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.472605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.472935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.472935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.472935] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.474998] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.475121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.475189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.475377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.475543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.475647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.475704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.475850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.475927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.476014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.476099] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.477322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.477432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.477645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.477745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.477866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.478040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.478337] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.478462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.478528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.478670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.478749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.478831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.478915] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.481704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.481855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.481923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.482237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.482425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.482716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.482799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.482958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.483075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.483140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.483223] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.484055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.484188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.484255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.484377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.484521] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.484615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.484676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.484812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.484888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.484970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.485064] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.492252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.492417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.492820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.492820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.492942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.493073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.493121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.493229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.493329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.493379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.493470] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.497026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.497310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.497310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.497472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.497750] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.497750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.497874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.497916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.498047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.498113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.500338] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.503635] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.503786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.503861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.505025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.505025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.505025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.519141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.519518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b1f6c30-ca79-4905-ab9e-12a9c0b30bad is going to be deleted. [ 796.525044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.525541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.583169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.583169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.583169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.583428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.774213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.774213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.775556] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.775724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.776866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.777021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.778024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.778151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.779081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.779218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.779959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.780108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.783273] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.784218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.784599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.784743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be deleted. [ 796.786071] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35e12398-e283-4ddb-933f-e2c8972e9c13: rpc.has_security_group_logging(os_id): False [ 796.787486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.787742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.819577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.819577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.831934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.832154] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5fc7c7e4-ccff-4f6f-b071-841331d702a0 is going to be deleted. [ 796.833402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.833791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.855913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.856732] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01849c7a-29c1-4280-be13-1fa17a01cb17 is going to be deleted. [ 796.857352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.858189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.860545] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.860729] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.860881] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.861152] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.861289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.861503] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 500e0eca-31c3-465b-97fc-c9eace117acf not found, creating... [ 796.861705] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.861895] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.862064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.862296] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.862431] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.862861] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.863125] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.863297] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.863771] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.863999] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.864534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 500e0eca-31c3-465b-97fc-c9eace117acf is going to be created. [ 796.889181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.889181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.894310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.894496] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be deleted. [ 796.895520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.895760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.898336] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.898624] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.898765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.899030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.899255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.899623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.926739] env[65443]: INFO networking_nsxv3.common.synchronization [None req-d963803c-2d45-45a2-ad7c-a9b937c2c34d None None] Enqueued Resource ID: a9b3876f-afb2-436e-a4e8-e182ca43b028 with Priority: HIGHEST for action port [ 796.928100] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.928268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.928977] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b3876f-afb2-436e-a4e8-e182ca43b028 with Priority: HIGHEST for action port [ 796.929387] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9b3876f-afb2-436e-a4e8-e182ca43b028 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.929509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9b3876f-afb2-436e-a4e8-e182ca43b028" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.929603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9b3876f-afb2-436e-a4e8-e182ca43b028" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.929935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9b3876f-afb2-436e-a4e8-e182ca43b028" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.930035] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9b3876f-afb2-436e-a4e8-e182ca43b028',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.937038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.937038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33573b4-6e20-4958-b534-744277031b44 is going to be deleted. [ 796.938570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.938904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.942515] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.975843] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.977126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.977269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.977346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.977557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.977728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.977824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.977884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.978042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.978130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.978215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.978393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.978557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.978557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.978636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.978772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.978859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.978918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.979102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.979195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.979279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.979369] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.980553] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.981324] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.996071] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.000138] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.007586] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.009910] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.010056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.011710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.011899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.011899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.012174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.012341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.012447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.012571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.012720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.012806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.012894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.013053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.013161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.013715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.013715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.013715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.013715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.013715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.013715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.013960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.013960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.013960] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.017729] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.019484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.019484] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9c98539-6490-4aa2-80d1-381c6299bd04 is going to be deleted. [ 797.020241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.020453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.071109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e1792da-b313-46fc-bec2-ab5ddb70bee3 is going to be deleted. [ 797.071925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.072169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.126269] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.126269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.139223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.139432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.141044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.141252] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e141f38-80d1-407b-9da2-ec4d8adb3e99 is going to be deleted. [ 797.142761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.143043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.143160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.143325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b1f6c30-ca79-4905-ab9e-12a9c0b30bad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.143854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.144051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.247328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.247532] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0fe6210d-3498-4e0f-b810-00e0478f00cb is going to be deleted. [ 797.248667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.248953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.249082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.249406] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.249535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.249611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.249807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.249895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.249993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be created. [ 797.251343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.251556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.251676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.251864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.252068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.252247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.252334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.252476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5fc7c7e4-ccff-4f6f-b071-841331d702a0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.253301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.253530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.253626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.253818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01849c7a-29c1-4280-be13-1fa17a01cb17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.253965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.254176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.254292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.254408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.255149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.255465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.255612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.255766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33573b4-6e20-4958-b534-744277031b44" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.281977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.282168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.282209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.282425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.282564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.283365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9c98539-6490-4aa2-80d1-381c6299bd04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.286486] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.286698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.286766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.286975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.287084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.287242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e1792da-b313-46fc-bec2-ab5ddb70bee3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.433372] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9b3876f-afb2-436e-a4e8-e182ca43b028 [ 797.433631] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.433816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.433858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.434085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.434190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.434307] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9b3876f-afb2-436e-a4e8-e182ca43b028 already deleted. [ 797.434390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9b3876f-afb2-436e-a4e8-e182ca43b028" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.445640] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.445897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.445973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.446215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.446308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.446414] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 797.453190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.453335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.453415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.453730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.453916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.482369] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc: rpc.has_security_group_logging(os_id): False [ 797.486027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.486027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.486027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.486027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.486027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.486027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e141f38-80d1-407b-9da2-ec4d8adb3e99" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.486027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 797.486027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca2c637c-a7f1-415d-b0a1-fc76f318aea5: rpc.has_security_group_logging(os_id): False [ 797.486966] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f2dbdb-92d8-4566-bb7c-8c740d6edde6: rpc.has_security_group_logging(os_id): False [ 797.504564] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 797.507321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 338befad-e097-41dd-903a-b87985d12b22: rpc.has_security_group_logging(os_id): False [ 797.507321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7ca5770-a687-4792-9de6-c002c902a32a: rpc.has_security_group_logging(os_id): False [ 797.510720] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ded103e4-c215-45f9-85d6-afc52b8ad0ec: rpc.has_security_group_logging(os_id): False [ 797.516903] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fefe930-a078-492b-8eab-26e076c8e507: rpc.has_security_group_logging(os_id): False [ 797.518603] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f: rpc.has_security_group_logging(os_id): False [ 797.530336] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.530556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.530556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.530882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.530995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.531175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0fe6210d-3498-4e0f-b810-00e0478f00cb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.581021] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.581021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.581021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.581021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.582054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.582405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.640594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.640787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.642229] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.642229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.647053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.647053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.650081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.650081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.650081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.650301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.651354] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.651354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.652592] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.652592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.657535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.658129] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.660189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.660189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.660189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.660189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.660189] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 797.661041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.661450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.677436] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.677689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.677754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.677994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.678439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.717210] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 797.744463] env[65443]: INFO networking_nsxv3.common.synchronization [req-3f419daa-2f79-4e11-8ac6-c1af22bed974 req-bdf12bf7-4162-4f6b-b4e6-a3377f26817b service nova] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 797.745137] env[65443]: INFO networking_nsxv3.common.synchronization [req-3f419daa-2f79-4e11-8ac6-c1af22bed974 req-bdf12bf7-4162-4f6b-b4e6-a3377f26817b service nova] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 797.745137] env[65443]: INFO networking_nsxv3.common.synchronization [req-3f419daa-2f79-4e11-8ac6-c1af22bed974 req-bdf12bf7-4162-4f6b-b4e6-a3377f26817b service nova] Enqueued Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 797.745820] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 797.746041] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 797.746719] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 797.746719] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.746911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.748049] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.748049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.748049] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-500e0eca-31c3-465b-97fc-c9eace117acf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.748049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.748049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.748049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.748335] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500e0eca-31c3-465b-97fc-c9eace117acf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.768765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.768765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.768934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.768934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.772673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.772953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.772953] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7ca5770-a687-4792-9de6-c002c902a32a is going to be updated. [ 797.774642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.774939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.837291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.837291] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec is going to be updated. [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.837291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.842112] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.842373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.910731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.910731] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.910731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.910731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.910731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.910731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.910731] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be updated. [ 797.911861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.911965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.967426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.968257] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.968257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.968257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.968564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.968647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.968789] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 797.971379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.972117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.011847] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.012143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.015173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.015488] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.015621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.015690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.015899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.016024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.016445] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.016550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.016550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.016836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.016836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.017047] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.017138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.017184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.017347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.017422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.017549] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 798.019936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.020108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.020167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.020435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.020648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.023300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.023560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.045969] env[65443]: INFO networking_nsxv3.common.synchronization [req-28186cfc-1ad7-4b31-ba42-adea74f9d3bf req-ed91ff36-cadb-4df2-b7ad-e93f45e8bc67 tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 798.046109] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 798.046365] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.046485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.046542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.046765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.046933] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.047068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.047132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.048382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.048382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.048382] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.053047] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: IN_PROGRESS for 2s [ 798.063429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.063769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.063875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.063929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.064154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.064241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.064342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 798.066297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.067324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.133960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.143716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.143716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.160208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.160840] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.161038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.161174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.161481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.161576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.161798] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 798.163849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.165816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.165816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.166240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.166240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.201023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 798.242446] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.242668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.247510] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.247682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.258279] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 500e0eca-31c3-465b-97fc-c9eace117acf with status ACTIVE [ 798.258760] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.258760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.258760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.258941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.259049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.259308] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.259453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.259453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.259699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.259780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.259914] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.260012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.260092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.260273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.260402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.260908] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 500e0eca-31c3-465b-97fc-c9eace117acf is going to be updated. [ 798.297828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.298320] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.298916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.299070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.299381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.299561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.299884] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.300026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.300091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.300299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.300476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.300844] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.300947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.301046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.301238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.301336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.301467] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 798.302910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.303220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.303387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.304856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.305138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.305391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.307571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.307838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.308041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.309316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.309572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.309796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.312024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.312408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.312675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.343075] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 798.343774] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: IN_PROGRESS for 2s [ 798.345783] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 798.360680] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.361027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.361027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.361164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.361915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.361915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.383730] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: IN_PROGRESS for 2s [ 798.410715] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 798.439138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.439138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.439138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.439138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.439138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.469341] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 798.507791] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 798.508715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.509130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.509429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.509913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.510249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.540757] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 798.553740] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.872162] env[65443]: INFO networking_nsxv3.common.synchronization [req-b5a79ef1-6767-45dd-8a84-db696fddb1a6 req-c556b239-b292-42ef-a0d4-1b370b4e08e0 tempest-ServersTestJSON-1600957378 tempest-ServersTestJSON-1600957378-project-member] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 798.872953] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 798.874121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.874121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.874121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.874724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.874724] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.874870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.875317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.875317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.875317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.875549] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.055168] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.158918] env[65443]: INFO networking_nsxv3.common.synchronization [req-66d02cea-ff96-4b09-b4cf-e58b0a4c0a2c req-052d06eb-c9db-4230-b01e-d626d377bce9 tempest-ListServersNegativeTestJSON-470596227 tempest-ListServersNegativeTestJSON-470596227-project-member] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 799.158918] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGHEST for action security_group_members [ 799.158918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.159312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.379643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.379643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.379819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.379878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.380129] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.380235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.380303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.380467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.380545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.380630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 already deleted. [ 799.380710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.519560] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-437 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.519912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-437" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.520086] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-437" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.520444] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-437" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.520818] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.521044] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.521216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.521520] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.521698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.521933] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.522071] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.522183] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.522299] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.522424] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.522599] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.522939] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.525268] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 799.525532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.547382] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.547792] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.547913] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.548196] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-437" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.548652] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.548912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.549110] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.549556] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.549775] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98774cc6-1cf4-4b8f-82e5-75f8b1f282ad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.560025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.560284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.560447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.560774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.560949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.561135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 799.597752] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.597964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.597964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.598297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.598453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.610524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 799.638418] env[65443]: INFO networking_nsxv3.common.synchronization [None req-82d4b138-c9b6-4a67-be03-8bc16ed73e59 None None] Enqueued Resource ID: 7d359604-f730-47af-b823-153ff73eb486 with Priority: HIGHEST for action port [ 799.639159] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d359604-f730-47af-b823-153ff73eb486 with Priority: HIGHEST for action port [ 799.639354] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d359604-f730-47af-b823-153ff73eb486 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.639503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d359604-f730-47af-b823-153ff73eb486" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.639575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d359604-f730-47af-b823-153ff73eb486" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.639856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d359604-f730-47af-b823-153ff73eb486" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.639947] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d359604-f730-47af-b823-153ff73eb486',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.730442] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 799.730666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.730857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.731110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.731412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.731560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.731649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.731833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.731942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.732044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.732176] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.733153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.733358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.733565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.733686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.733751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.733898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.733974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.734078] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.052787] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.053156] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.053211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.054036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.054036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.054036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad not found, creating... [ 800.054394] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.054394] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.056726] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.056726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.056726] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad is going to be created. [ 800.080345] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: SUCCESS [ 800.080592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.090410] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.090652] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.091112] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.091519] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.091781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.092044] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.142273] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d359604-f730-47af-b823-153ff73eb486 [ 800.142772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.142934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.143016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.143227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.143320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.143421] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d359604-f730-47af-b823-153ff73eb486 already deleted. [ 800.143532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d359604-f730-47af-b823-153ff73eb486" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.226227] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 800.226515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.237157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.237157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.237157] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.365953] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: SUCCESS [ 800.366184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.367745] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 800.367842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.370765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 800.370951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.402035] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: SUCCESS [ 800.402035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.424294] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 800.425025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.488749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 800.488972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.559280] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 800.560076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.739600] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [req-b5a79ef1-6767-45dd-8a84-db696fddb1a6 req-98e32af0-178b-4030-918a-8eeba7596c8a service nova] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [req-b5a79ef1-6767-45dd-8a84-db696fddb1a6 req-98e32af0-178b-4030-918a-8eeba7596c8a service nova] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [req-b5a79ef1-6767-45dd-8a84-db696fddb1a6 req-98e32af0-178b-4030-918a-8eeba7596c8a service nova] Enqueued Resource ID: 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad with Priority: HIGHEST for action port [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_rules [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 800.844764] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad with Priority: HIGHEST for action port [ 800.844764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.844764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.844764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.844764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.845151] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.846343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.846461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.846525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.846852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.846852] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.846981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.847042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.847178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.847278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.847395] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.848646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.848813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.849669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.849669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.849669] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98774cc6-1cf4-4b8f-82e5-75f8b1f282ad',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.241683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.242022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.242022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.242138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.242234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.242330] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 801.278572] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.278933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.279116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.279423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.279581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.291579] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 801.351629] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.351855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.352112] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.353195] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad with status ACTIVE [ 801.353866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.353866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.353866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.354076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.354076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.354206] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.354363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.354454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.354636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.354739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.354945] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.355364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.355364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.355364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.355627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.355627] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98774cc6-1cf4-4b8f-82e5-75f8b1f282ad is going to be updated. [ 801.384327] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.384503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.384551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.384723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.384857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.385029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98774cc6-1cf4-4b8f-82e5-75f8b1f282ad" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.626151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 801.626507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.626789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.627068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.627582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.627793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.627906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.628133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.628302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.628452] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.859625] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.132142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.132373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.132448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.132749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.132842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.133062] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.133174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.133239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.133389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.133477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.133580] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be updated. [ 802.168310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.168529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.168604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.168767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.168910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.180400] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: IN_PROGRESS for 2s [ 802.361300] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.361717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.361717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.361839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.361902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.361972] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 is going to be created. [ 802.393935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.394256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.394256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.394455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.395054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.412895] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: UNINITIALIZED for 2s [ 803.117347] env[65443]: INFO networking_nsxv3.common.synchronization [req-d6272f51-c7bc-4ce4-82e1-011e520e69e8 req-a87ed232-7b66-4c43-a84a-0341f99c60bd tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 803.118054] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 803.118518] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.118651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.118736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.120167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.120167] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.120167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.120167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.120167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.120167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.120167] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.305095] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 803.305095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.305331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.305470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.305713] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.305855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.305926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.306117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.306198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.306295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.306462] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.306572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.306683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.306792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.306937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.307051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.307105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.307256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.307350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.307451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.307546] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.622734] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.623097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.623097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.623351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.644558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.644882] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.645039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.645131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.645355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.645447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.645560] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 803.678167] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.678337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.678404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.678617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.678761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.688472] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 803.810299] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 803.844052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.844209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.844279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.844533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.864628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.864810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.864810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.864949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.865097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.865182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.865400] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.865519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.866822] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.866822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.866822] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 803.952697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.952697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.952697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.952953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.952953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.968491] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 804.192394] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fefe930-a078-492b-8eab-26e076c8e507 in Status: SUCCESS [ 804.192394] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 deletion is rescheduled due to dependency. [ 804.192394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.423749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: SUCCESS [ 804.424663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.424663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.424663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.424663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.424663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.424663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.424965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.424965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.424965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.425083] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.927648] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.432888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01bb9589-319b-4790-ae93-ec8c6f99bc54: rpc.has_security_group_logging(os_id): False [ 805.451063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.451323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.451435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.451760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.451760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.452026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.452183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.452274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.452386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.452469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.452798] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 is going to be created. [ 805.531347] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.531347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.531347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.531347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.531347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.545970] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: IN_PROGRESS for 2s [ 805.704389] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 805.704563] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e deletion is rescheduled due to dependency. [ 805.704679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.982056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 805.982800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.982800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.982800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.982800] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.485604] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.485604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.485604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.485871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.485871] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.486011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.486160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.486387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.487104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.487104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.487104] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.991772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.992103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.992103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.992370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.992454] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.992516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.992622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.992828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.992873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.992930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.993095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.993187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.993409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.993546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.993654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.993710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.994038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.994038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.994038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.994176] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.497163] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 807.520093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.520251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.520329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.520625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.520729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.520938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.521054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.521121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.521282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.521360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.521555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.521648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.521710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.521854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.521928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.522385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.522554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.522759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.522960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.523117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.523248] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 807.558266] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: SUCCESS [ 807.558322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.610768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.610977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.610977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.611253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.611414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.628043] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 808.121449] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 808.121449] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 808.783697] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 808.783697] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 808.784028] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 808.784170] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 808.784436] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.784677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.784677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.784798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.784940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.785187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.785187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.785250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.785327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.785559] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.786361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.786361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.786449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.786752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.786752] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.786875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.786875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.787630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.787630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.787630] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.828010] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 808.828197] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 808.828327] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_rules [ 808.828449] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 808.828643] env[65443]: INFO networking_nsxv3.common.synchronization [req-0e6b0809-f68f-498a-b64e-90c7c29b1068 req-e2a895f6-9965-4061-93a8-c16e0e0c9fdc tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 808.829064] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 808.829200] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_rules [ 808.829293] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 808.829382] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 808.829468] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 808.829733] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.829834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.830127] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.830296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.830351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.830655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.830733] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.831547] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-500e0eca-31c3-465b-97fc-c9eace117acf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.831775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.831775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.832519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.832519] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500e0eca-31c3-465b-97fc-c9eace117acf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.832968] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.833070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.834026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.834026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.289476] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.290688] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.336025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.336025] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 500e0eca-31c3-465b-97fc-c9eace117acf with status ACTIVE [ 809.336025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.336025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.336025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.336025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.336618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.336618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.336618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.336618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.336618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 500e0eca-31c3-465b-97fc-c9eace117acf is going to be updated. [ 809.362028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.362028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.362028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.362028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.362028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.362375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.643834] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 809.644173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.644423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.644669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.644749] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.797614] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.799528] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.149625] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.149625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.303200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.303544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.303544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.303748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.304037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.304037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be created. [ 810.305379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.305498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.305572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.306339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.306339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.306339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 810.332363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.332636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.332636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.333303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.333303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.337263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.337263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.337263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.337263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.337263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.344028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 810.345183] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: UNINITIALIZED for 2s [ 811.833819] env[65443]: INFO networking_nsxv3.common.synchronization [None req-30a61d83-7adb-4a30-8eb7-c53df95059b5 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 811.834393] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 811.834702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.834816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.834879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.835181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.835558] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.944267] env[65443]: INFO networking_nsxv3.common.synchronization [None req-2f801469-aa7d-4540-b1bc-186ca8ab9cff tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 811.944853] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 811.945374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.945374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.358050] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 812.358050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.358050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.358255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.358445] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.360166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.360166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.360166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.360166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.360166] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.363339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: SUCCESS [ 812.363339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.364562] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.364639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.364683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.364864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.364994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.365045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c155a28-d058-4976-8391-4c7cb25222de already deleted. [ 812.365126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.365275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.365423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.365608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.365714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.365775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.365914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.365989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.366533] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.367369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.367941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.367941] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.864989] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.869686] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.900657] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.900845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.900913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.901151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.901903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.902110] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c155a28-d058-4976-8391-4c7cb25222de already deleted. [ 812.902297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.367694] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.372205] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.869996] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.870327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.870327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.870467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.870555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.870659] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 813.875840] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.875947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.875996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.876196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.876299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.876408] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be updated. [ 813.914410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.914555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.914626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.914829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.914974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.917036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.917036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.917036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.917686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.917686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.932291] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: IN_PROGRESS for 2s [ 813.932291] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 814.003988] env[65443]: INFO networking_nsxv3.common.synchronization [req-d676b01c-5026-481f-9176-50b9e05593b1 req-02facb78-d68b-41c1-a5aa-b332025249a7 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 814.005093] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 814.005440] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.005567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.005636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.005902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.006071] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.006174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.006236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.006385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.006470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.006563] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.385236] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.385479] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.385631] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.385935] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.386284] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.386473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.386590] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.386857] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.387063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.387318] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.387455] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 814.387592] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 814.387719] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 814.387863] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 814.387989] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 814.388164] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 814.411674] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 814.411956] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 814.412203] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 814.412484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-647" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.412986] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-0edc05d5-4709-4158-81d9-6be362ad36e0 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.413289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.413433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.413941] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.414141] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0edc05d5-4709-4158-81d9-6be362ad36e0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.510284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.510284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.510284] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 already deleted. [ 814.510284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.647098] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 814.647098] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 814.647356] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 814.647864] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 814.647990] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 814.648221] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 814.648563] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.648745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.648856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.649170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.649355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.649695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.649695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.649916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.650131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.650308] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.651403] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.651403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.651694] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.651826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.701499] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 814.701575] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 814.701763] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_rules [ 814.701937] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 814.702054] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_rules [ 814.702222] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 814.702397] env[65443]: INFO networking_nsxv3.common.synchronization [req-b9b0cc4d-6e99-45be-aabf-d4a2684fe779 req-312649da-1a27-40dc-a7f5-30a0189480df tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 814.703021] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_rules [ 814.703175] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_rules [ 814.703327] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 814.703434] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 500e0eca-31c3-465b-97fc-c9eace117acf with Priority: HIGHEST for action port [ 814.703549] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_rules [ 814.703669] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 814.703782] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 814.704192] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.704313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.704593] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.704688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.704952] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.705264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.705339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-500e0eca-31c3-465b-97fc-c9eace117acf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.705411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.705482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.705896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.705896] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('500e0eca-31c3-465b-97fc-c9eace117acf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.707664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6167d0aa-08da-4989-8f04-2f2aaa2c96bd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.707664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.707664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.707664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.707664] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.708983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.708983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.709145] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.709206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.918064] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.918064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.918064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.918064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.918558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.918558] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 0edc05d5-4709-4158-81d9-6be362ad36e0 not found, creating... [ 814.918558] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.918690] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.918780] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.918999] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.919150] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.919427] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.919576] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.919687] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.919889] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.920042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.920194] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 0edc05d5-4709-4158-81d9-6be362ad36e0 is going to be created. [ 814.947410] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.947657] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.947768] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.948024] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.948253] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.948472] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.153237] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.211020] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 500e0eca-31c3-465b-97fc-c9eace117acf with status ACTIVE [ 815.213080] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.213242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.213311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.213537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.213698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.213827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.213928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.213989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.214156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.214233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.214415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.214505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.214565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.214700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.214772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.214854] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 500e0eca-31c3-465b-97fc-c9eace117acf is going to be updated. [ 815.216062] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.216174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.245033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.245033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.245033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.245033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.245320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.245355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-500e0eca-31c3-465b-97fc-c9eace117acf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.656107] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.666264] env[65443]: INFO networking_nsxv3.common.synchronization [req-d676b01c-5026-481f-9176-50b9e05593b1 req-53047c56-d35d-47d8-a74a-05f387a432a9 service nova] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 815.666264] env[65443]: INFO networking_nsxv3.common.synchronization [req-d676b01c-5026-481f-9176-50b9e05593b1 req-53047c56-d35d-47d8-a74a-05f387a432a9 service nova] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 815.666264] env[65443]: INFO networking_nsxv3.common.synchronization [req-d676b01c-5026-481f-9176-50b9e05593b1 req-53047c56-d35d-47d8-a74a-05f387a432a9 service nova] Enqueued Resource ID: 0edc05d5-4709-4158-81d9-6be362ad36e0 with Priority: HIGHEST for action port [ 815.666716] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_rules [ 815.666846] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 815.667358] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0edc05d5-4709-4158-81d9-6be362ad36e0 with Priority: HIGHEST for action port [ 815.667866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.667999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.668049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.668240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.668348] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.669089] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.669377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.669377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.669451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.669594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.669685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.669746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.669926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.670022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.670110] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.671193] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0edc05d5-4709-4158-81d9-6be362ad36e0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.671193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.671193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.671347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.671347] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0edc05d5-4709-4158-81d9-6be362ad36e0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.949435] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: SUCCESS [ 815.949691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.950200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.950409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.950704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.950704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.950818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.950912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.950988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.951093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.951269] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.952911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 815.953011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.953122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.953284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.953480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.953550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.953594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.953772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.953889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.953999] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.954713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.954875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.955039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.955134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.955209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.955327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.955857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.955857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.955857] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.956927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.956927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.957065] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.957167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.957227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.957360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.957434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.957517] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.158610] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.158821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.158915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.159179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.159276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.159379] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd is going to be created. [ 816.172365] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.173556] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.173701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.173833] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0edc05d5-4709-4158-81d9-6be362ad36e0 with status ACTIVE [ 816.173988] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.174112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.174187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.174482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.174482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.174653] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.174777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.174836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.175180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.175180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.175345] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.175401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.175471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.175615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.175689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.175819] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0edc05d5-4709-4158-81d9-6be362ad36e0 is going to be updated. [ 816.186103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.186666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.186666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.186666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.187036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.200289] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd in Status: UNINITIALIZED for 2s [ 816.209712] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.210452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.211062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.211062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.211062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.211321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0edc05d5-4709-4158-81d9-6be362ad36e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.457217] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.459957] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.460248] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.460850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.460850] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.679157] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.961150] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a1c7770-3f5f-4c68-ab25-a549eda7a214: rpc.has_security_group_logging(os_id): False [ 816.962360] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.963259] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.983814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.983814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.983814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.985506] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be created. [ 817.041918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.042113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.042171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.042333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.042503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.053137] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: IN_PROGRESS for 2s [ 817.182406] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.182563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.182629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.182852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.182950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.183071] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 is going to be created. [ 817.213283] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.213481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.213481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.213644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.213785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.223544] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: UNINITIALIZED for 2s [ 817.465501] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.465683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.465729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.465970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.466080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466177] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 817.467568] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.467699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.467763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.467910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.467995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.468105] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be updated. [ 817.513131] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.513371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.513483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.513838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.515182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.516116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.516268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.516321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.516521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.516666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.537498] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: IN_PROGRESS for 2s [ 817.538754] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 817.706063] env[65443]: INFO networking_nsxv3.common.synchronization [req-05c1d071-e238-4c66-9c13-d950276734f3 req-4f7467f4-134e-4745-aa7f-cd2d541f32ab tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 817.706224] env[65443]: INFO networking_nsxv3.common.synchronization [req-05c1d071-e238-4c66-9c13-d950276734f3 req-4f7467f4-134e-4745-aa7f-cd2d541f32ab tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 817.706289] env[65443]: INFO networking_nsxv3.common.synchronization [req-05c1d071-e238-4c66-9c13-d950276734f3 req-4f7467f4-134e-4745-aa7f-cd2d541f32ab tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 817.706871] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd with Priority: HIGHEST for action security_group_members [ 817.707385] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 817.707385] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 with Priority: HIGHEST for action security_group_members [ 817.707385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.707570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.707692] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.707770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.707941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a1c7770-3f5f-4c68-ab25-a549eda7a214 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.708026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.212744] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd in Status: SUCCESS [ 818.213048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.213341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.213476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.213591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.213993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.213993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.213993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.214170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.214234] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.720054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.720297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.720297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.720373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.720446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.720658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.720745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.720808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.720959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.721081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.721179] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd is going to be deleted. [ 818.805079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.805228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.805299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.805516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.805813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.805813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.805927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.806339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.806510] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.806611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.806719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.806814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.806894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.807047] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.065376] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: SUCCESS [ 819.065635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.065844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.066069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.066179] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.235707] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: UNINITIALIZED for 4s [ 819.309660] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.309966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.309966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.310261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.310261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.310365] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.310473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.310473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.310590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.310663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.310750] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd already deleted. [ 819.310833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.310935] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.311927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.312016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.312174] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.312264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.312323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.312458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.312532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.312619] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.550186] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 in Status: SUCCESS [ 819.550530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.551339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 819.551510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.551662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.551892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.552090] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.552198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.552267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.552423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.552508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.552594] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.553576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.555054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.555054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.555054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.555054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.555054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.555054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.555054] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.593549] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.593813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.593994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.594126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.594242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.594350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be deleted. [ 819.643011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.643204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.643301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.643612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.643873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.643950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.814510] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6167d0aa-08da-4989-8f04-2f2aaa2c96bd',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.815840] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.815986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.816111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.816272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.816361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.816566] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.816675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.816748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.816881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.816936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.817030] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd already deleted. [ 819.817109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.056866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.056866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.057089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.057188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.057245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.057440] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.057542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.057602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.057748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.057825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.057912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 is going to be deleted. [ 820.058918] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.122058] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.122257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.122306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.122642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.122808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.122966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.123215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.123458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.123695] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.123847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.123944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.124177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.124298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.124441] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a1c7770-3f5f-4c68-ab25-a549eda7a214',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.317944] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6167d0aa-08da-4989-8f04-2f2aaa2c96bd: rpc.has_security_group_logging(os_id): False [ 820.350887] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.351150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.351236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.351587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.351771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.351944] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.352067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.352241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.352419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.352498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.352591] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd is going to be created. [ 820.376043] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd], does not exist path=[/infra/domains/default/groups/6167d0aa-08da-4989-8f04-2f2aaa2c96bd]."\n}' [ 820.376246] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd [ 820.376293] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 820.413187] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.413337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.413428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.413637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.414504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.414798] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.414912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.414968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.415458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.415587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.415749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.415873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.415950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.416050] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6167d0aa-08da-4989-8f04-2f2aaa2c96bd is going to be created. [ 820.440262] env[65443]: INFO networking_nsxv3.common.synchronization [req-1403f857-41e0-40fa-aa2e-8a4f98544fd3 req-e628ba55-f350-45c3-8e88-5b3c04608e2f tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 820.441288] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd], does not exist path=[/infra/domains/default/groups/6167d0aa-08da-4989-8f04-2f2aaa2c96bd]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd [ 820.441437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6167d0aa-08da-4989-8f04-2f2aaa2c96bd" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.441983] env[65443]: Traceback (most recent call last): [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 820.442061] env[65443]: return func(*args, **kwargs) [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 820.442061] env[65443]: res.raise_for_status() [ 820.442061] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 820.442061] env[65443]: raise HTTPError(http_error_msg, response=self) [ 820.442061] env[65443]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd [ 820.442061] env[65443]: During handling of the above exception, another exception occurred: [ 820.442061] env[65443]: Traceback (most recent call last): [ 820.442061] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 820.442061] env[65443]: listener.cb(fileno) [ 820.442061] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 820.442061] env[65443]: result = function(*args, **kwargs) [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 820.442061] env[65443]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 820.442061] env[65443]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 820.442061] env[65443]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 820.442061] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 820.442061] env[65443]: res.raise_for_status() [ 820.442061] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 820.442061] env[65443]: raise HTTPError(http_error_msg, response=self) [ 820.442061] env[65443]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/6167d0aa-08da-4989-8f04-2f2aaa2c96bd [ 820.442834] env[65443]: Removing descriptor: 56 [ 820.442834] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 820.442979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.443081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.443147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.443326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.443469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.443567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.443627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.443785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.443891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.443991] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.561322] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.628038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.628038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.628038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.628038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.628355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.628559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.628712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.628812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.629030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.629166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.629293] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a1c7770-3f5f-4c68-ab25-a549eda7a214 already deleted. [ 820.629415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a1c7770-3f5f-4c68-ab25-a549eda7a214" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.946432] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.064356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.064485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.064526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.064818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.064935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.065074] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 821.096987] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.097284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.097284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.097487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.097656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.107261] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 821.245974] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: SUCCESS [ 821.246458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.246635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.246884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.247093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.247207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.247271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.247422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.247502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.247585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.247683] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.449031] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.750290] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.953391] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.953391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.953391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.953391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.953391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.953391] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 821.983289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.983436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.983505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.983720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.983861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.998366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 822.253172] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25b7cad8-5307-463b-8d72-d5e21db9d2b3: rpc.has_security_group_logging(os_id): False [ 822.285132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.285356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.285356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.285602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.285719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.285986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.286099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.286164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.286428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.286428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.286643] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 is going to be created. [ 822.357353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.357353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.357353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.357572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.358178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.368535] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: IN_PROGRESS for 2s [ 823.119038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 823.119465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.119465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.119645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.119873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.120065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.120170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.120429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.120570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.120754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.121017] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.121122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.121236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.121460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.121653] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.121794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.121881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.122080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.122212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.122472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.122472] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.123476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.123645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.124628] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.124628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.124628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.124628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.124628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.124628] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.626283] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 823.627536] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.721416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.721586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.721637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.721841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.741470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.741742] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.741874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.741942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.742146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.742229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.742417] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.742515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.742578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.742733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.742816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.743023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.743119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.743181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.743318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.743395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.743484] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 823.809774] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.809921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.810016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.810210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.810360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.831648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 824.011840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 824.012116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.102852] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d53cd89-5618-41bf-ba22-cc7ecff9e36f req-6f9d2d48-d510-4bd7-a761-c9839b0c3959 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 824.103863] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 824.103863] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.103863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.104171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.104305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.104364] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.104446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.104500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.104642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.104721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.104817] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.129637] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.380649] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: SUCCESS [ 824.381241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.469947] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-322" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-322" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-322" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.474326] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.474326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.474326] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.474326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 824.474326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 824.474326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 824.474326] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 824.474326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 824.474326] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 824.492457] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 824.492622] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 824.492807] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 824.492997] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-322" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.493325] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.493487] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.493600] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.493917] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.494063] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8fdd9-ceb0-4d8c-838a-c5c007bf9845',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.607110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.607110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.607110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.607355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.607355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.607494] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.607681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.607923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.608131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.608253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.608431] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a already deleted. [ 824.608491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.632649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.632881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.632973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.633226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.633364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.633510] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 824.662781] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.663041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.663125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.663338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.663487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.672122] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 824.997276] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.997276] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.997452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.997573] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.997746] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.997977] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 not found, creating... [ 824.998269] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.998428] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.998575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.998843] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.998995] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.999324] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.999478] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.999598] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.999805] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.999968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.000123] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 is going to be created. [ 825.026501] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.027235] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.027235] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.027430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.027503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.028612] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.748842] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d53cd89-5618-41bf-ba22-cc7ecff9e36f req-3e924797-2897-433f-b9b7-0601b837db0d service nova] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 825.749140] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d53cd89-5618-41bf-ba22-cc7ecff9e36f req-3e924797-2897-433f-b9b7-0601b837db0d service nova] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 825.749233] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d53cd89-5618-41bf-ba22-cc7ecff9e36f req-3e924797-2897-433f-b9b7-0601b837db0d service nova] Enqueued Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 825.749853] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 825.749956] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 825.750036] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 825.750382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.750508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.750611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.750855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.750961] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.753482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.753606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.753666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.753953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.754148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.754273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.754313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.754468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.754576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.754673] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.755676] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.755676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.755676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.755884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.755994] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8fdd9-ceb0-4d8c-838a-c5c007bf9845',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.845849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 825.846097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.846363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.846623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.846717] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.257834] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.258042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.258174] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.259071] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with status ACTIVE [ 826.259247] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.259359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.259424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.259627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.259712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.259897] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.261827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.261827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.261827] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 is going to be updated. [ 826.284992] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.285200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.285251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.285421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.285548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.285697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.349030] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.349259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.683496] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.683496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.683496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.683976] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.765422] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.815894] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0db61f-943d-482c-bd34-0110d49ffd9a req-f95c22c2-ca19-429f-93cb-9bdcbea35b3c tempest-InstanceActionsNegativeTestJSON-382423160 tempest-InstanceActionsNegativeTestJSON-382423160-project-member] Enqueued Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 826.816540] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 826.816893] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.817611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.817611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.817611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.817611] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.817850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.817850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.817850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.817947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.818128] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.117592] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.117833] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.118011] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.118426] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.118690] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.118854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.118971] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.119214] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.119372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.119573] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.119681] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.119798] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.119905] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.120018] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.120120] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.120244] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.143318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.143494] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.143638] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.143855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.144210] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-f91e1298-e3d0-4446-93f7-4bb05a665981 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.144405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.144545] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.144883] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.145058] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91e1298-e3d0-4446-93f7-4bb05a665981',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.188148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.188354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.189169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.189169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.189169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.189468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.189506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.189612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.189728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.189918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.190083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.190154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.190372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.190558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.190696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.190860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.191062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.191266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.191266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.191399] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.267866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.268036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.268112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.268439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.268528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.268695] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be created. [ 827.299426] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.299588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.299674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.299831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.299999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.310358] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: UNINITIALIZED for 2s [ 827.320980] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.321147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.321222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.321436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.321533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.321710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.321805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.321865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.322013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.322095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.322180] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 already deleted. [ 827.322259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.647823] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.648142] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.648211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.648520] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.648676] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.648844] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port f91e1298-e3d0-4446-93f7-4bb05a665981 not found, creating... [ 827.649158] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.649338] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.649465] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.649726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.649828] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.650134] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.650284] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.650396] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.650655] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.650783] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.650930] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: f91e1298-e3d0-4446-93f7-4bb05a665981 is going to be created. [ 827.678341] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.678584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.678777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.679318] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.679564] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.679840] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.695788] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9: rpc.has_security_group_logging(os_id): False [ 827.716829] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.716982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.717048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.717295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.717418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.717685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.717860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.717860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.718178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.718300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.718555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.718719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.718837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.719023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.719152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.719409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.719547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.719653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.719850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.719968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.720109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 827.816447] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.816825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.816825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.816956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.817025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.842812] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 828.416517] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0db61f-943d-482c-bd34-0110d49ffd9a req-ec7474c9-6818-4562-9e05-8adedb31825f service nova] Enqueued Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_rules [ 828.416517] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0db61f-943d-482c-bd34-0110d49ffd9a req-ec7474c9-6818-4562-9e05-8adedb31825f service nova] Enqueued Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 828.416667] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0db61f-943d-482c-bd34-0110d49ffd9a req-ec7474c9-6818-4562-9e05-8adedb31825f service nova] Enqueued Resource ID: f91e1298-e3d0-4446-93f7-4bb05a665981 with Priority: HIGHEST for action port [ 828.417484] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_rules [ 828.417484] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 828.417578] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f91e1298-e3d0-4446-93f7-4bb05a665981 with Priority: HIGHEST for action port [ 828.418190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.418356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.418452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.418742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.418833] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.419842] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.419842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.419979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.420048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.423706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.423706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.423706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.423874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.424124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.424124] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.424868] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f91e1298-e3d0-4446-93f7-4bb05a665981 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.424968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.425042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.425191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.425265] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f91e1298-e3d0-4446-93f7-4bb05a665981',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.926831] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.929515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.929672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.930205] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f91e1298-e3d0-4446-93f7-4bb05a665981 with status ACTIVE [ 828.930357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.932114] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.932114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.932449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.932449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.932449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.932449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.932594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.932677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.932779] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f91e1298-e3d0-4446-93f7-4bb05a665981 is going to be updated. [ 828.954443] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.954582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.954704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.955848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.956029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.956438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f91e1298-e3d0-4446-93f7-4bb05a665981" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.331432] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 829.331679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.331856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.332106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.332303] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.332421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.332483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.332631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.332710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.332863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.332958] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.430657] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.838034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.838034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.838034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.838034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.839708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.840342] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.842656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.842656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.842656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.842656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.842656] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.865232] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 829.865466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.932935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.933382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.933382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.933382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.933550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.933550] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 is going to be created. [ 829.961833] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.964021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.964021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.964021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.964021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.975045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: UNINITIALIZED for 2s [ 830.345148] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2988673a-9380-4a98-9c63-c238cd5cfc7a: rpc.has_security_group_logging(os_id): False [ 830.377979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.378226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.378351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.378671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.378826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.379188] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.379373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.379480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.379747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.379889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.380217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.380379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.380491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.380720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.380857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.381166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.381319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.381434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.381667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.381800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.381931] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be created. [ 830.459898] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.460121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.460121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.460272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.460453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.474952] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 831.987391] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: SUCCESS [ 831.987720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.987802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.988040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.988240] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.988354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.988431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.988589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.988670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.988753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.988855] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.490545] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 832.490724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.491519] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.491719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.491719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.492716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.492716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.493043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.493043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.493234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.493385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.493440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.494222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.494222] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.494222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.494222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.494588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.494588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.494588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.494742] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.998653] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7be5dea-7e21-4d7d-bb55-1264c2bd2864: rpc.has_security_group_logging(os_id): False [ 833.017259] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.017356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.017430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.017730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.017730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.017995] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.017995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.018137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.018239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.018304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.018492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.018587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.018669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.018785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.018931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.019084] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.019152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.019209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.019309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.019461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.019461] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 is going to be created. [ 833.089500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.089500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.089500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.089500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.089500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.102015] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: IN_PROGRESS for 2s [ 833.419433] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 833.419617] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 834.501023] env[65443]: INFO networking_nsxv3.common.synchronization [req-a2af9546-2e57-4b6d-981d-b34d3698e7a2 req-31c1216e-ab20-4485-a866-505bce432483 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 834.501666] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 834.501954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.502439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.502519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.502825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.502977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.503103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.503167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.503329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.503415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.503512] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.974795] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.975021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.975141] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.975686] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.976029] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.976238] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.976410] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.976683] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.976887] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.977155] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.977296] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 834.977429] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 834.977592] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 834.977667] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 834.977798] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 834.977961] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.007139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.007317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.007409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.007619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.007767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.008078] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.008201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.008266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.008479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.008558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.008653] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b already deleted. [ 835.008729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.013589] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.013589] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 835.013589] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.013589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.013589] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-c28c03f9-de49-4287-bfbd-2a47961278d1 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.013589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.013589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.013589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.013589] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c28c03f9-de49-4287-bfbd-2a47961278d1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.116977] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: SUCCESS [ 835.117239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.515270] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.515578] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.515620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.515898] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.516060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.516221] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port c28c03f9-de49-4287-bfbd-2a47961278d1 not found, creating... [ 835.516477] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.516624] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.516737] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.517154] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.517343] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.517670] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.517955] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.518016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.518303] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.518443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.518584] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: c28c03f9-de49-4287-bfbd-2a47961278d1 is going to be created. [ 835.538996] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.539218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.539399] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.539873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.540188] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.540437] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.275939] env[65443]: INFO networking_nsxv3.common.synchronization [req-a2af9546-2e57-4b6d-981d-b34d3698e7a2 req-a7e37df6-6941-4a6e-9522-d804c00fae57 service nova] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 836.276122] env[65443]: INFO networking_nsxv3.common.synchronization [req-a2af9546-2e57-4b6d-981d-b34d3698e7a2 req-a7e37df6-6941-4a6e-9522-d804c00fae57 service nova] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 836.278600] env[65443]: INFO networking_nsxv3.common.synchronization [req-a2af9546-2e57-4b6d-981d-b34d3698e7a2 req-a7e37df6-6941-4a6e-9522-d804c00fae57 service nova] Enqueued Resource ID: c28c03f9-de49-4287-bfbd-2a47961278d1 with Priority: HIGHEST for action port [ 836.278600] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_rules [ 836.278600] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 836.278600] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c28c03f9-de49-4287-bfbd-2a47961278d1 with Priority: HIGHEST for action port [ 836.278600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.278600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.278600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.278600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.278600] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.279157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.282305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.282305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.282697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.282697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.282882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.282882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.282965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.283082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.283168] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.284461] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c28c03f9-de49-4287-bfbd-2a47961278d1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.284590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.284640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.284967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.284967] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c28c03f9-de49-4287-bfbd-2a47961278d1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.788060] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.788060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.788060] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.788890] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c28c03f9-de49-4287-bfbd-2a47961278d1 with status ACTIVE [ 836.789718] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.789718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.789718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.789718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.789718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.790069] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.790069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.790069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.790224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.790929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.790929] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.790929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.790929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.790929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.790929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.790929] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c28c03f9-de49-4287-bfbd-2a47961278d1 is going to be updated. [ 836.838455] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.838746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.838894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.839135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.839306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.839537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c28c03f9-de49-4287-bfbd-2a47961278d1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.292567] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.795632] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.796164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.796164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.796164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.796345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.796345] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b is going to be created. [ 837.849557] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.849557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.849557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.849775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.849967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.863714] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: UNINITIALIZED for 2s [ 838.320677] env[65443]: INFO networking_nsxv3.common.synchronization [req-82f82ed6-e6e4-4fc4-904c-b1a371474929 req-64a23bc8-4bab-41f0-9c15-49af03a89f88 tempest-ServerPasswordTestJSON-1060978021 tempest-ServerPasswordTestJSON-1060978021-project-member] Enqueued Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 838.321209] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 838.322670] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.322670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.322670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.322670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.322670] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.323011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.323011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.323011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.323147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.323231] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.727345] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.727570] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-623" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.727644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-623" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.727996] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-623" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728281] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.728435] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.728547] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.728774] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.728916] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.729177] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.729628] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.729751] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.729884] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.729981] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.730190] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.730423] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.750398] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.750588] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.750679] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.750894] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-623" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.751227] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d6bfbcac-84d9-42cb-a750-69aff983f1f3 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.751397] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.751513] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.751842] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.752036] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6bfbcac-84d9-42cb-a750-69aff983f1f3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.826503] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.826503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.826503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.826503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.826503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.827079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.827079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.827079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.827079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.827079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.827079] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 already deleted. [ 838.827079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.255307] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.255597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.255701] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.256034] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.256215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.256377] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d6bfbcac-84d9-42cb-a750-69aff983f1f3 not found, creating... [ 839.256691] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.256879] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.257025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.257266] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.257404] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.257718] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.257900] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.258502] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.258857] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.259019] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.259176] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d6bfbcac-84d9-42cb-a750-69aff983f1f3 is going to be created. [ 839.288802] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.289111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.289286] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.289658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.289991] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.290325] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.876796] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: SUCCESS [ 839.877151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.877501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.877924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.878199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.878472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.878636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.878850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.878953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.879132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.879263] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.019927] env[65443]: INFO networking_nsxv3.common.synchronization [req-82f82ed6-e6e4-4fc4-904c-b1a371474929 req-3599a84a-8ad1-4c64-976f-4043943f4400 service nova] Enqueued Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_rules [ 840.020206] env[65443]: INFO networking_nsxv3.common.synchronization [req-82f82ed6-e6e4-4fc4-904c-b1a371474929 req-3599a84a-8ad1-4c64-976f-4043943f4400 service nova] Enqueued Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 840.020269] env[65443]: INFO networking_nsxv3.common.synchronization [req-82f82ed6-e6e4-4fc4-904c-b1a371474929 req-3599a84a-8ad1-4c64-976f-4043943f4400 service nova] Enqueued Resource ID: d6bfbcac-84d9-42cb-a750-69aff983f1f3 with Priority: HIGHEST for action port [ 840.020801] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_rules [ 840.020938] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 840.021080] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6bfbcac-84d9-42cb-a750-69aff983f1f3 with Priority: HIGHEST for action port [ 840.021371] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.021517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.021568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.021854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.021892] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.023652] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.023652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.023652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.023797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.023942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.024074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.024166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.025629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.025907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.025907] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.028430] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6bfbcac-84d9-42cb-a750-69aff983f1f3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.028623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.028731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.028986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.029091] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6bfbcac-84d9-42cb-a750-69aff983f1f3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.095449] env[65443]: INFO networking_nsxv3.common.synchronization [req-20524693-6d8e-470f-89d3-c1ad1cca3496 req-540c6784-120b-4863-bf66-838e4f028bfc tempest-InstanceActionsNegativeTestJSON-382423160 tempest-InstanceActionsNegativeTestJSON-382423160-project-member] Enqueued Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 840.095449] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 with Priority: HIGHEST for action security_group_members [ 840.095449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.095449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.095449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.095879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.096666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.096857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.096857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.097035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.097138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.098042] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7be5dea-7e21-4d7d-bb55-1264c2bd2864',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.381453] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.529049] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.535983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.535983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.536984] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6bfbcac-84d9-42cb-a750-69aff983f1f3 with status ACTIVE [ 840.536984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.536984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.536984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.537429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.537429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.537606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.537606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.537832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.537925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6bfbcac-84d9-42cb-a750-69aff983f1f3 is going to be updated. [ 840.568343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.568511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.568567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.568769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.568909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.569096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6bfbcac-84d9-42cb-a750-69aff983f1f3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.600705] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.601025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.601135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.601348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.601438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.601645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.601780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.601857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.602015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.602175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.602285] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 is going to be updated. [ 840.653297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.653516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.653516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.654088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.654088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.679127] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: IN_PROGRESS for 2s [ 840.884734] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38621128-a58c-43d0-ab77-1ae5a5975b7b: rpc.has_security_group_logging(os_id): False [ 840.904358] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.906212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.906403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.906705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.908019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.908019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.908019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.908019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.908019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.908019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.908019] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b is going to be created. [ 840.982058] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.982058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.982058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.982241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.982423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.994353] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: IN_PROGRESS for 2s [ 841.032217] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.534959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.535165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.535227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.535460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.535557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.535634] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 is going to be created. [ 841.567291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.567605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.567778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.567976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.568171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.580659] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: UNINITIALIZED for 2s [ 842.700537] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 in Status: SUCCESS [ 842.700537] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7be5dea-7e21-4d7d-bb55-1264c2bd2864 deletion is rescheduled due to dependency. [ 842.700537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7be5dea-7e21-4d7d-bb55-1264c2bd2864" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.846438] env[65443]: INFO networking_nsxv3.common.synchronization [req-a7eea15a-24c8-49e0-afeb-aea8928ea570 req-46dccb88-de6d-49aa-b30d-72647abc4999 tempest-ListImageFiltersTestJSON-1965178563 tempest-ListImageFiltersTestJSON-1965178563-project-member] Enqueued Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 842.846960] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540878-f6a1-4e06-86e4-4e60026efbeb with Priority: HIGHEST for action security_group_members [ 842.847288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-23540878-f6a1-4e06-86e4-4e60026efbeb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.847410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.847473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.848031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.848031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.848031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.848031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.851984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.851984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.852159] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23540878-f6a1-4e06-86e4-4e60026efbeb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.008942] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: SUCCESS [ 843.009215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.354808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.355033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.355072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.355317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.377670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.377942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.378102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.378186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.378416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.378523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.378620] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb is going to be updated. [ 843.414794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.415708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.415708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.415708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.415708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.430265] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: IN_PROGRESS for 2s [ 843.594637] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: SUCCESS [ 843.594637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.594637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.594637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.595235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.595235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.596462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.596462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.596462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.596895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.596895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.959203] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 843.959576] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 843.960097] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 843.960641] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 843.961052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.961244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.961342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.961665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.961944] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.962102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.962187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.962980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.962980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.962980] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.964111] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.965377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.965377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.965377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.965377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.965377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.965377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.967309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.967309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.967309] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.974566] env[65443]: INFO networking_nsxv3.common.synchronization [req-b28892e8-2904-4af1-ae95-7547cfb05417 req-afe13698-0413-4e8f-a7fe-d0c468cd7427 tempest-ServersTestManualDisk-536655571 tempest-ServersTestManualDisk-536655571-project-member] Enqueued Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 843.977045] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec with Priority: HIGHEST for action security_group_members [ 843.977371] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ded103e4-c215-45f9-85d6-afc52b8ad0ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.977496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.977566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.977765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.977945] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.978089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.978089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.978396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.978396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.978506] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ded103e4-c215-45f9-85d6-afc52b8ad0ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.021692] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 844.021893] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.022149] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_rules [ 844.022324] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 844.022496] env[65443]: INFO networking_nsxv3.common.synchronization [req-a6ba4be7-8d9a-4c2e-a604-2d78ed5eeb0f req-bd9d3b68-151e-4d34-8952-8fc1300993e3 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 844.023397] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 844.023548] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_rules [ 844.023698] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 844.023812] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.024501] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 844.024882] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.025053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.025123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.025357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.025443] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.026470] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.026590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.026650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.026942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.027077] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.027998] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.028121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.028191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.028370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.028459] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8fdd9-ceb0-4d8c-838a-c5c007bf9845',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.029737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.029737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.029737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.030084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.099353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.100508] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.100508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.100907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.100907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.100907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.100907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.101067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.101111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.101644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.101644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.101644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.101835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.101835] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.470627] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.474590] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.482254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.482254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.482254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.482681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.514628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.515023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.515195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.515269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.515480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.515569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.515664] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec is going to be updated. [ 844.533052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.533052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.533307] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.533376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.533527] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with status ACTIVE [ 844.533682] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.534557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.535783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.535783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.535783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.535783] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.535783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.535783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.536162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.536162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.536297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.536297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.536378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.536496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.536584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.536770] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 is going to be updated. [ 844.551766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.551955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.552043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.552302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.552534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.567043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.567043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.567043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.567043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.567043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.567043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.567806] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: IN_PROGRESS for 2s [ 844.607216] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 510d8b5d-287f-4b17-a124-e17cca11cba8: rpc.has_security_group_logging(os_id): False [ 844.631623] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.631623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.631623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.631854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.631890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.632166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.632260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.632392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.632477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.632610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.632826] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.633158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.633158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.633158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.633300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.634074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.634074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.634074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.634074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.634074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.634074] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 is going to be created. [ 844.752751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.753054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.753160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.753525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.753598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.768000] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: IN_PROGRESS for 2s [ 844.796777] env[65443]: INFO networking_nsxv3.common.synchronization [req-72e71016-5c98-4670-9fd1-42b3ef37fee5 req-6a6cd0ad-ba3e-43b3-85ed-752bf34f9034 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 844.796865] env[65443]: INFO networking_nsxv3.common.synchronization [req-72e71016-5c98-4670-9fd1-42b3ef37fee5 req-6a6cd0ad-ba3e-43b3-85ed-752bf34f9034 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.797389] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec with Priority: HIGHEST for action security_group_members [ 844.797526] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.797809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.797927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.798154] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.798289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.855478] env[65443]: INFO networking_nsxv3.common.synchronization [req-72e71016-5c98-4670-9fd1-42b3ef37fee5 req-6a6cd0ad-ba3e-43b3-85ed-752bf34f9034 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 844.855478] env[65443]: INFO networking_nsxv3.common.synchronization [req-72e71016-5c98-4670-9fd1-42b3ef37fee5 req-6a6cd0ad-ba3e-43b3-85ed-752bf34f9034 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.855786] env[65443]: INFO networking_nsxv3.common.synchronization [req-72e71016-5c98-4670-9fd1-42b3ef37fee5 req-6a6cd0ad-ba3e-43b3-85ed-752bf34f9034 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 844.856450] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_rules [ 844.856669] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 844.856855] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with Priority: HIGHEST for action port [ 844.859031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.859208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.859523] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.860460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.860687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.863669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.863788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.864021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.864264] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d8fdd9-ceb0-4d8c-838a-c5c007bf9845',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.974535] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.979291] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.368321] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 with status ACTIVE [ 845.369079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.369079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.369079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.372238] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.372238] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.372238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.372238] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d8fdd9-ceb0-4d8c-838a-c5c007bf9845 is going to be updated. [ 845.421361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.421591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.421591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.421860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.422037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.422205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d8fdd9-ceb0-4d8c-838a-c5c007bf9845" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.440541] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23540878-f6a1-4e06-86e4-4e60026efbeb in Status: SUCCESS [ 845.440604] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23540878-f6a1-4e06-86e4-4e60026efbeb deletion is rescheduled due to dependency. [ 845.440717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23540878-f6a1-4e06-86e4-4e60026efbeb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.476624] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.476834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.476901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.477145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.477275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.477423] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec is going to be created. [ 845.483483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.483645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.483709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.487063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.487063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.487063] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 845.541479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.541630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.541695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.541870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.542068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.554203] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.554519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.554519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.554974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.554974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.565663] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec in Status: UNINITIALIZED for 2s [ 845.576035] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 845.702571] env[65443]: INFO networking_nsxv3.common.synchronization [req-a69c15a1-94bf-4bba-8018-1099c4e18066 req-3e7bbf54-c838-4a2a-a841-1b40ae50965f tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 845.703206] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 845.703918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.704066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.704168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.704558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.705677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.705677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.705677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.705677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.705677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.705677] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.208776] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.579811] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec in Status: SUCCESS [ 846.579989] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ded103e4-c215-45f9-85d6-afc52b8ad0ec deletion is rescheduled due to dependency. [ 846.580156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ded103e4-c215-45f9-85d6-afc52b8ad0ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.713466] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.786378] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: SUCCESS [ 846.786378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.216900] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.217299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.217299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.217515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.217584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.217714] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 847.250136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.250328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.250391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.250966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.251159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.259645] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 847.580102] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 847.580395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.580724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.580949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.581116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.581581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.581581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.581581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.581581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.581900] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.583756] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec in Status: SUCCESS [ 847.583756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.583756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.583756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.584139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.584227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.584281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.584459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.584591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.584707] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.086993] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.090212] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.090347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.090411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.090620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.090706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.090971] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.091110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.091174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.091326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.091404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.091491] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec is going to be deleted. [ 848.122108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.122774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.122774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.122774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.122983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.122983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.123688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.123688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.124769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.124769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.124769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.124769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.124769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.124769] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.591010] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.626831] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.626982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.627091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.628081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.628081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec already deleted. [ 848.628081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.628412] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.629157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.629529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.629716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.629823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.629890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.630210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.630538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.630538] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.092656] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.092824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.092934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.093185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.093278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.093381] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 849.127382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.128090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.128090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.128090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.128090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.132674] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.133784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.133984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.134105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.134329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.134448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.134651] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.134752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.134817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.135978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.135978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.135978] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec already deleted. [ 849.135978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.140446] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 849.273528] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 849.273754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.636394] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec: rpc.has_security_group_logging(os_id): False [ 849.654765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.655010] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.655095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.655361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.655735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.655735] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.655851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.655851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.655988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.656076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.657618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec is going to be created. [ 849.678218] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec], does not exist path=[/infra/domains/default/groups/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec]."\n}' [ 849.678218] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec [ 849.678218] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 849.714734] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.714734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.714932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.714978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.715875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.716172] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.716290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.716349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.716499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.716614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.716614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.717034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.717034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.717251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.717251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.717326] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec is going to be created. [ 849.740928] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec], does not exist path=[/infra/domains/default/groups/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec [ 849.740928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.741193] env[65443]: Traceback (most recent call last): [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 849.741193] env[65443]: return func(*args, **kwargs) [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 849.741193] env[65443]: res.raise_for_status() [ 849.741193] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 849.741193] env[65443]: raise HTTPError(http_error_msg, response=self) [ 849.741193] env[65443]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec [ 849.741193] env[65443]: During handling of the above exception, another exception occurred: [ 849.741193] env[65443]: Traceback (most recent call last): [ 849.741193] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 849.741193] env[65443]: listener.cb(fileno) [ 849.741193] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 849.741193] env[65443]: result = function(*args, **kwargs) [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 849.741193] env[65443]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 849.741193] env[65443]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 849.741193] env[65443]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 849.741193] env[65443]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 849.741193] env[65443]: res.raise_for_status() [ 849.741193] env[65443]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 849.741193] env[65443]: raise HTTPError(http_error_msg, response=self) [ 849.741193] env[65443]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e1dcc63a-7d16-4ae5-9ccc-efaf3c7547ec [ 849.741193] env[65443]: Removing descriptor: 61 [ 850.112026] env[65443]: INFO networking_nsxv3.common.synchronization [req-4a0aa83e-b020-4c33-aefb-684ef806255e req-a7963198-4cd0-4c31-b138-26653d89fd72 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 850.112338] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 850.112997] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.112997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.112997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.113378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.113378] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.113378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.113378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.113555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.113594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.114166] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.518169] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.518990] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.518990] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.518990] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.519191] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.519258] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.519321] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.519540] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.519689] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.519911] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.520503] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 850.520503] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 850.520503] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 850.520503] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 850.520503] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 850.520815] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 850.551112] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 850.551348] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 850.551480] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 850.551667] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.552015] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-cc58a40b-ed15-459d-836b-ede0116a24e8 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.552209] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.552328] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.552672] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.552807] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc58a40b-ed15-459d-836b-ede0116a24e8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.617132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.617388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.617804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.617804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.654866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.655333] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.655333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.655333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.655568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.655568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.655668] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 850.691240] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.691493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.691559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.691764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.691917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.703717] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 851.055777] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.056131] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.056251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.056589] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.056866] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.057085] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port cc58a40b-ed15-459d-836b-ede0116a24e8 not found, creating... [ 851.057531] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.057745] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.057864] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.058144] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.058370] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.058625] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.058805] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.058926] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.059298] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.059493] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.059670] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: cc58a40b-ed15-459d-836b-ede0116a24e8 is going to be created. [ 851.087606] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.087927] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.088077] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.088377] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.088615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.088864] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.159513] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 851.159513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.159772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.159899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.160259] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.160405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.160475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.160706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.160747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.160809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.161051] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.162943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.162943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.163111] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.163174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.163214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.163340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.163423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.163516] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.664043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.664043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.666550] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.768213] env[65443]: INFO networking_nsxv3.common.synchronization [req-f3dfd457-52a4-4f45-bb09-225c78373b6f req-6448be46-decc-4ef0-8d4c-bda41905d7de tempest-ServerPasswordTestJSON-1060978021 tempest-ServerPasswordTestJSON-1060978021-project-member] Enqueued Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 851.768861] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 with Priority: HIGHEST for action security_group_members [ 851.769554] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-510d8b5d-287f-4b17-a124-e17cca11cba8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.769723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.769832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.770109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.770350] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.770516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.770625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.770899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.771046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.771188] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('510d8b5d-287f-4b17-a124-e17cca11cba8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.784122] env[65443]: INFO networking_nsxv3.common.synchronization [req-4a0aa83e-b020-4c33-aefb-684ef806255e req-29f01514-fdab-46ee-99c3-099f3dfa6ddb service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 851.784122] env[65443]: INFO networking_nsxv3.common.synchronization [req-4a0aa83e-b020-4c33-aefb-684ef806255e req-29f01514-fdab-46ee-99c3-099f3dfa6ddb service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 851.784122] env[65443]: INFO networking_nsxv3.common.synchronization [req-4a0aa83e-b020-4c33-aefb-684ef806255e req-29f01514-fdab-46ee-99c3-099f3dfa6ddb service nova] Enqueued Resource ID: cc58a40b-ed15-459d-836b-ede0116a24e8 with Priority: HIGHEST for action port [ 851.785076] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 851.785382] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 851.785576] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc58a40b-ed15-459d-836b-ede0116a24e8 with Priority: HIGHEST for action port [ 851.785996] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.786275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.786459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.786777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.787548] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.790225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.790225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.792711] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc58a40b-ed15-459d-836b-ede0116a24e8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.792711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.792711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.792711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.792711] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc58a40b-ed15-459d-836b-ede0116a24e8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.026671] env[65443]: INFO networking_nsxv3.common.synchronization [req-f724b6d5-5b31-49b2-a1ff-197338b050f7 req-641aee5d-8f0c-4b28-9c26-639da6dc1582 tempest-ServerRescueTestJSONUnderV235-172963800 tempest-ServerRescueTestJSONUnderV235-172963800-project-member] Enqueued Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 852.027234] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a with Priority: HIGHEST for action security_group_members [ 852.028402] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.028565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.168719] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.273452] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.273622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.273687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.273899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.289157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.289294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.293985] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc58a40b-ed15-459d-836b-ede0116a24e8 with status ACTIVE [ 852.294565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.294565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.294565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.294746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.294746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.295857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.295857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.295857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.296320] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc58a40b-ed15-459d-836b-ede0116a24e8 is going to be updated. [ 852.297859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.298083] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.298219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.299097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.299097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.299097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.299097] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 is going to be updated. [ 852.324176] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.324427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.324427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.324561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.324651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.324811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc58a40b-ed15-459d-836b-ede0116a24e8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.334186] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.334356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.334770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.334770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.334770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.344681] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: IN_PROGRESS for 2s [ 852.670522] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.670898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.670898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.671205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.671363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.671535] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 852.717872] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 852.718121] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 852.718215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.718364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.718586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.718782] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.718899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.718967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.719130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.719217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.719315] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.723341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.723341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.723341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.723341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.723612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.739626] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 853.221786] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.724473] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.227176] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.227456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.227456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.227709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.227836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.227964] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 854.272062] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.272238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.272307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.272973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.272973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.285087] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 854.362742] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 in Status: SUCCESS [ 854.362742] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 510d8b5d-287f-4b17-a124-e17cca11cba8 deletion is rescheduled due to dependency. [ 854.362742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-510d8b5d-287f-4b17-a124-e17cca11cba8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.748883] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 854.749159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.749329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.749609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.749758] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.749903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.750017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.750216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.750301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.750400] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.253470] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.253677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.253799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.254099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.292617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.292883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.293079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.293153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.293366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.293450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.293542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 855.345935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.346134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.346197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.346374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.346523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.357041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 856.295097] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 856.296258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.296258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.296258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.296258] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.296258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.296258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.296562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.296562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.296629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.296741] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.799076] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.799259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.799259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.799534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.799728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.799843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.799926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.800098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.800260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.800590] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.800700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.800781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.800945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.801121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.801230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.801302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.801459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.801542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.801649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.801758] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.029367] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 857.029546] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=5 [ 857.304202] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7259b9-1e79-42d6-87f5-2acdaf792fd0: rpc.has_security_group_logging(os_id): False [ 857.329469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.329609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.329609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.330023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.330023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.330228] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.330334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.330414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.330701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.330701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.331873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.331873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.331873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.332404] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 857.372884] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 857.373183] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a deletion is rescheduled due to dependency. [ 857.373329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.373577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.373848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.374094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.374262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.374357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.374561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.374668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.374797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.374999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-2988673a-9380-4a98-9c63-c238cd5cfc7a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.375129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.375193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.375379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.375539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.375644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.375707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.375846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.375925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.376048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.376180] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.377187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.377375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.377541] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.377685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.377792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.377973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.378087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.378209] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.410392] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.410656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.410731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.410997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.411172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.435743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 857.880747] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2988673a-9380-4a98-9c63-c238cd5cfc7a: rpc.has_security_group_logging(os_id): False [ 857.882393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.882559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.882609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.882803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.882885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.883104] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.883220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.883268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.883466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.883611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.883611] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 857.905996] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.906400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.906531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.906767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.906896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.907289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.907400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.907443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.907592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.907670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.907891] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.908000] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.908089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.908232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.908307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.908507] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.908616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.908676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.908812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.908884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.908970] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be updated. [ 857.919616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.919616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.919616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.919914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.919914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.929978] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 857.984110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.984110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.984110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.984110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.985110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.001426] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: IN_PROGRESS for 2s [ 859.451511] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 859.451899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.941357] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 859.941357] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a deletion is rescheduled due to dependency. [ 859.942213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.017038] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a in Status: SUCCESS [ 860.017038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.017256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.017378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.017481] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2988673a-9380-4a98-9c63-c238cd5cfc7a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.539896] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.540279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.540279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.540405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.540405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.540514] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2988673a-9380-4a98-9c63-c238cd5cfc7a is going to be deleted. [ 860.597280] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.597456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.597456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.597671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.597762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.597888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2988673a-9380-4a98-9c63-c238cd5cfc7a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.848769] env[65443]: INFO networking_nsxv3.common.synchronization [req-a7e4a362-0bd6-42b4-be39-2e431f81c1e2 req-99270bc5-bde6-40b6-8f6e-5ba7aa0eabee tempest-ServersWithSpecificFlavorTestJSON-1627004517 tempest-ServersWithSpecificFlavorTestJSON-1627004517-project-member] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 860.849372] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGHEST for action security_group_members [ 860.849672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.849785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.849844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.850056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.850198] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.850291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.850347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.850481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.850562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.850649] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.355971] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.355971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.355971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.355971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.423632] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.423632] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be updated. [ 861.423632] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.423632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.433042] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: IN_PROGRESS for 2s [ 863.447529] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 338befad-e097-41dd-903a-b87985d12b22 in Status: SUCCESS [ 863.447529] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 338befad-e097-41dd-903a-b87985d12b22 deletion is rescheduled due to dependency. [ 863.447529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.598824] env[65443]: INFO networking_nsxv3.common.synchronization [req-d2323d28-98e4-462f-b487-ee93630e27f2 req-e717cc34-288f-4856-9ec5-99567588d5a4 tempest-ServerMetadataNegativeTestJSON-2090714491 tempest-ServerMetadataNegativeTestJSON-2090714491-project-member] Enqueued Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 865.599949] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 865.599949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.600131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.600131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.600474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.600673] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.600753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.600811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.601025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.601059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.601611] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.983035] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-232 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.983279] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-232" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.983434] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-232" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.983789] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-232" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.984094] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.984308] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.984464] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.984837] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.984918] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.985206] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.985333] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.985911] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.985911] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.985911] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.985911] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.986140] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 866.011029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 866.011029] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 866.011029] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 866.011029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-232" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.011029] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-27182e01-99d7-4b5f-966d-c7158a84614f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.011364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.011364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.011818] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.012018] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27182e01-99d7-4b5f-966d-c7158a84614f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.104158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.104371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.104451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.104722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.104820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.105152] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.105292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.105617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.105617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.105617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.105779] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 already deleted. [ 866.105921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.326037] env[65443]: INFO networking_nsxv3.common.synchronization [None req-afef0848-d5c2-44f2-9d2f-85233c03fa2e None None] Enqueued Resource ID: 91a665bc-1b83-43c2-abf1-e611e5aba663 with Priority: HIGHEST for action port [ 866.326135] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a665bc-1b83-43c2-abf1-e611e5aba663 with Priority: HIGHEST for action port [ 866.326671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a665bc-1b83-43c2-abf1-e611e5aba663 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.326798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a665bc-1b83-43c2-abf1-e611e5aba663" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.326867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a665bc-1b83-43c2-abf1-e611e5aba663" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.327130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a665bc-1b83-43c2-abf1-e611e5aba663" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.327215] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a665bc-1b83-43c2-abf1-e611e5aba663',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.515297] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.515867] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.516234] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.517277] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.517605] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.517920] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 27182e01-99d7-4b5f-966d-c7158a84614f not found, creating... [ 866.518410] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.519017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.519017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.519239] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.519460] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.519939] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.521526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.521526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.521526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.521526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.521526] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 27182e01-99d7-4b5f-966d-c7158a84614f is going to be created. [ 866.545981] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.545981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.545981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.545981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.545981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.545981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.830328] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91a665bc-1b83-43c2-abf1-e611e5aba663 [ 866.830632] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.830717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.830806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.831042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.831187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.831313] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91a665bc-1b83-43c2-abf1-e611e5aba663 already deleted. [ 866.831412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a665bc-1b83-43c2-abf1-e611e5aba663" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.341043] env[65443]: INFO networking_nsxv3.common.synchronization [req-d2323d28-98e4-462f-b487-ee93630e27f2 req-efa40a59-c495-4580-82fa-ff229f1926c8 service nova] Enqueued Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_rules [ 867.341043] env[65443]: INFO networking_nsxv3.common.synchronization [req-d2323d28-98e4-462f-b487-ee93630e27f2 req-efa40a59-c495-4580-82fa-ff229f1926c8 service nova] Enqueued Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 867.341043] env[65443]: INFO networking_nsxv3.common.synchronization [req-d2323d28-98e4-462f-b487-ee93630e27f2 req-efa40a59-c495-4580-82fa-ff229f1926c8 service nova] Enqueued Resource ID: 27182e01-99d7-4b5f-966d-c7158a84614f with Priority: HIGHEST for action port [ 867.341139] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_rules [ 867.341232] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 867.341331] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27182e01-99d7-4b5f-966d-c7158a84614f with Priority: HIGHEST for action port [ 867.341607] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.341725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.341792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.342340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.342481] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.343603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.344191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.345247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.345247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.345247] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.345481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.345665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.346039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.346039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.346205] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.347393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-27182e01-99d7-4b5f-966d-c7158a84614f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.347575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.347685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.348207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.349414] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27182e01-99d7-4b5f-966d-c7158a84614f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.853777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.854057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.854108] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.855046] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27182e01-99d7-4b5f-966d-c7158a84614f with status ACTIVE [ 867.855223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.855342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.855408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.855612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.855698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.855923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.855980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.856061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.856275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.856362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.856543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.856651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.856714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.856856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.856931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.858963] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27182e01-99d7-4b5f-966d-c7158a84614f is going to be updated. [ 867.884451] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.884604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.884656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.884875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.884986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.885167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27182e01-99d7-4b5f-966d-c7158a84614f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.360428] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.826274] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b2c38eaf-0853-4987-b507-45a86f1bedd7 None None] Enqueued Resource ID: 2e9b3d8c-3f57-427b-b3cc-5c838353831c with Priority: HIGHEST for action port [ 868.826864] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e9b3d8c-3f57-427b-b3cc-5c838353831c with Priority: HIGHEST for action port [ 868.828175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e9b3d8c-3f57-427b-b3cc-5c838353831c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.828348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e9b3d8c-3f57-427b-b3cc-5c838353831c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.828436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e9b3d8c-3f57-427b-b3cc-5c838353831c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.828722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e9b3d8c-3f57-427b-b3cc-5c838353831c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.828828] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e9b3d8c-3f57-427b-b3cc-5c838353831c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.864970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.865292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.865292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.865432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.865502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.865601] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 is going to be created. [ 868.898128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.898128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.898128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.898274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.899424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.910936] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: UNINITIALIZED for 2s [ 869.333611] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e9b3d8c-3f57-427b-b3cc-5c838353831c [ 869.333839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.333973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.334101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.334327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.334415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.334555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e9b3d8c-3f57-427b-b3cc-5c838353831c already deleted. [ 869.334653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e9b3d8c-3f57-427b-b3cc-5c838353831c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.733790] env[65443]: INFO networking_nsxv3.common.synchronization [req-c58cc023-5779-446e-a377-bf23f5ac638c req-382e7a11-0028-4f95-b6d9-ac748dc3373f tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 870.734475] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 870.734806] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.734929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.734996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.735490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.735727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.735960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.736753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.737089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.737395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.737554] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.949855] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: SUCCESS [ 870.950091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.950309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.950537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.950732] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.950846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.950910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.951125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.951234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.951327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.951419] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.136157] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.136516] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.136516] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.136753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.137941] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.138364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.138564] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.140030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.140030] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.140030] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.140030] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.140030] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.140030] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.140030] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.140030] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.140030] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.160997] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.161329] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.161654] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.161823] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.162252] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.162544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.162784] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.163205] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.163471] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.244031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.244245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.244353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.244726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.245435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.245742] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.246186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.246345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.246595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.246682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.246809] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be deleted. [ 871.285158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.285316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.285390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.285598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.285690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.285785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.458977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.458977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.458977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.459267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.459370] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.459429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.459468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.459628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.459710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.459797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.460302] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.460302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.460302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.460302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.460435] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.460472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.460590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.460641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.460719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.460817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.460918] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.666686] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.666686] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.666686] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.666930] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.667090] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.667313] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 not found, creating... [ 871.667599] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.667952] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.667952] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.668118] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.668263] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.668545] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.668716] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.668979] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.669270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.669371] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.669521] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 is going to be created. [ 871.695221] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.695463] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.695585] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.695892] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.696165] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.696424] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.966479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d885f9be-7315-49b0-bdb6-9777836ebd30: rpc.has_security_group_logging(os_id): False [ 871.987120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.987120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.987313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.987397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.987490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.987646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.987737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.987801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.987938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.988026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.988281] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.988281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.988360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.988473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.988545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.988734] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.988826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.988878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.989022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.989103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.989369] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 is going to be created. [ 872.071720] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.072059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.072059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.072334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.072579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.086933] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: IN_PROGRESS for 2s [ 872.521663] env[65443]: INFO networking_nsxv3.common.synchronization [req-c58cc023-5779-446e-a377-bf23f5ac638c req-3c646f53-ed9c-4532-b02f-993810dd87af service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 872.521929] env[65443]: INFO networking_nsxv3.common.synchronization [req-c58cc023-5779-446e-a377-bf23f5ac638c req-3c646f53-ed9c-4532-b02f-993810dd87af service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 872.525018] env[65443]: INFO networking_nsxv3.common.synchronization [req-c58cc023-5779-446e-a377-bf23f5ac638c req-3c646f53-ed9c-4532-b02f-993810dd87af service nova] Enqueued Resource ID: 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 with Priority: HIGHEST for action port [ 872.525018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 872.525018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 872.525018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 with Priority: HIGHEST for action port [ 872.525018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.525018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.525018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.525018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.525018] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.526555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.526789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.526832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.527060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.527160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.527252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.527311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.527513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.527569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.527618] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.530148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.530257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.530330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.530560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.531143] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.027491] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.027883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.032266] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.033476] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 with status ACTIVE [ 873.033680] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.033806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.033905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.034203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.034301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.034490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.034598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.034677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.034818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.034895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.035175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.035299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.035420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.035504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.035579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.035691] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7 is going to be updated. [ 873.058052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.058215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.058287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.058499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.058634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.058793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c182ede-67e3-4ce5-9e35-fa5ccbab7ca7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538728] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.041037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.043018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.043018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.043018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.043018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.043018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 874.069847] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.070035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.070127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.071626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.071851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.086623] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: UNINITIALIZED for 2s [ 874.103571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: SUCCESS [ 874.103571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.936241] env[65443]: INFO networking_nsxv3.common.synchronization [req-04d0e291-6313-4d72-ac39-d907d31c22d0 req-18fb06ca-15c2-4809-b9c0-b5d10d167b5b tempest-FloatingIPsAssociationNegativeTestJSON-2092950691 tempest-FloatingIPsAssociationNegativeTestJSON-2092950691-project-member] Enqueued Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 874.937619] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 874.937979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.938187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.938334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.938603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.938921] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.939085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.939179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.939384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.939519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.939652] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.322487] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-513 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.323868] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-513" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.323868] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-513" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.328275] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-513" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.328275] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.328480] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.328611] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.328841] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.328980] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.329208] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.329313] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.329415] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.329524] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.329734] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.329822] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.329988] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.353955] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.353955] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.354152] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.354282] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-513" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.354721] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-e97ab755-59f1-4811-b4fe-697fbc01203d taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.354914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.355059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.355402] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.355585] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97ab755-59f1-4811-b4fe-697fbc01203d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.442591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.442591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.442591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.442771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.442855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.443268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.443400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.443467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.443629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.443710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.443801] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a already deleted. [ 875.443882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.859153] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.859433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.859564] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.859928] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.860158] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.860336] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port e97ab755-59f1-4811-b4fe-697fbc01203d not found, creating... [ 875.860663] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.860832] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.860952] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.861304] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.861452] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.861761] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.861976] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.862143] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.862369] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.862508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.862677] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: e97ab755-59f1-4811-b4fe-697fbc01203d is going to be created. [ 875.890288] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.890616] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.890733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.891041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.891351] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.891534] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.101595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 876.101823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.101993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.102277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.102480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.102598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.102666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.102830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.102982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.102982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.103153] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.606993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.607491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.607491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.607491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.607689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.607770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.607770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.607911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.608071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.608126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.608237] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.608309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.608369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.608502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.608636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.608723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.608779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.608909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.608982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.609073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.609164] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.620058] env[65443]: INFO networking_nsxv3.common.synchronization [req-04d0e291-6313-4d72-ac39-d907d31c22d0 req-e303b94c-2143-4896-8c77-c953de91dcf7 service nova] Enqueued Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_rules [ 876.620058] env[65443]: INFO networking_nsxv3.common.synchronization [req-04d0e291-6313-4d72-ac39-d907d31c22d0 req-e303b94c-2143-4896-8c77-c953de91dcf7 service nova] Enqueued Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 876.620058] env[65443]: INFO networking_nsxv3.common.synchronization [req-04d0e291-6313-4d72-ac39-d907d31c22d0 req-e303b94c-2143-4896-8c77-c953de91dcf7 service nova] Enqueued Resource ID: e97ab755-59f1-4811-b4fe-697fbc01203d with Priority: HIGHEST for action port [ 876.620999] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_rules [ 876.621186] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 876.621344] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e97ab755-59f1-4811-b4fe-697fbc01203d with Priority: HIGHEST for action port [ 876.621905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.622075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.622128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.622423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.622466] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.624701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.625462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.625531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.625737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.625905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.626029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.626088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.626244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.626335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.626434] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.627486] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e97ab755-59f1-4811-b4fe-697fbc01203d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.627486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.627486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.627656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.627727] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e97ab755-59f1-4811-b4fe-697fbc01203d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.829305] env[65443]: INFO networking_nsxv3.common.synchronization [req-db27bf24-8453-4a74-b1fe-28856bea0375 req-9601fc7e-4aee-4b44-a06d-97087342630b tempest-ServersTestJSON-1600957378 tempest-ServersTestJSON-1600957378-project-member] Enqueued Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 876.830245] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 with Priority: HIGHEST for action security_group_members [ 876.830684] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-01bb9589-319b-4790-ae93-ec8c6f99bc54 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.830874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.830978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.831321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.831563] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.831716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.831819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.832073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.832220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.832393] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01bb9589-319b-4790-ae93-ec8c6f99bc54',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.111957] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d34e09-75e3-43fa-8d8c-5bb269633d94: rpc.has_security_group_logging(os_id): False [ 877.130321] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.130477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.130797] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.132808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.132965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.133031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.133351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.133452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.133667] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.135083] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.135083] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.135083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.136081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.136081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.136081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 877.137183] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e97ab755-59f1-4811-b4fe-697fbc01203d with status ACTIVE [ 877.137183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.137183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.137183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.137381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.137455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.138479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.138479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.138479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.138479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.138479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.138479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.138479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.138904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.138904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.138904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.138904] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e97ab755-59f1-4811-b4fe-697fbc01203d is going to be updated. [ 877.171038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.171221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.171309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.171600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.171784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.172160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e97ab755-59f1-4811-b4fe-697fbc01203d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.219110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.219427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.219647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.220114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.220432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.241194] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 877.335108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.335339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.335339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.335567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.386354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.386354] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.386354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.386354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.386354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.386354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.386354] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 is going to be updated. [ 877.428020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.428106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.428159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.428358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.428493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.439970] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: IN_PROGRESS for 2s [ 877.641674] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.144388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.144579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.144579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.144803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.144832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.144928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a is going to be created. [ 878.176585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.176585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.176810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.176917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.177036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.190415] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: UNINITIALIZED for 2s [ 879.267055] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 879.267055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.451075] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 in Status: SUCCESS [ 879.451075] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01bb9589-319b-4790-ae93-ec8c6f99bc54 deletion is rescheduled due to dependency. [ 879.451075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01bb9589-319b-4790-ae93-ec8c6f99bc54" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.067933] env[65443]: INFO networking_nsxv3.common.synchronization [req-c0667109-e4d2-4dc5-a64a-a1ca653c22c9 req-dbf723e5-dec0-4fae-a7ed-b1a97004134e tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 880.067933] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 880.068413] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.068558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.068827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.068931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.069236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.069558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.069558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.069702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.069702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.069774] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.209758] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: SUCCESS [ 880.210106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.210366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.210678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.210961] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.211158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.211263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.211528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.211652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.211789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.213313] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.572698] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.573078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.573078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.573966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.574193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.574449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.574563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.574629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.574799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.574938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.574967] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 880.609873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.609873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.610328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.610676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.611195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.621178] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 880.720114] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.720114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.720437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.720487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.720703] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.720836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.720950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.721217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.721401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.721601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.721900] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.721996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.722095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.722274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.722495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.722614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.722723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.722919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.723098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.723347] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.227721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c429cab-3fa0-42ef-9802-e81f7371a11a: rpc.has_security_group_logging(os_id): False [ 881.249320] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.249461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.249533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.249751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.249839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.250056] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.250156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.250221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.250375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.250448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.250614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.250704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.250764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.250901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.250974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.252592] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.252737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.252808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.252975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.253069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.253219] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a is going to be created. [ 881.360029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.360215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.360283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.360480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.360646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.376215] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: IN_PROGRESS for 2s [ 881.560187] env[65443]: INFO networking_nsxv3.common.synchronization [req-29eb43cc-eecb-4629-b080-80cf5ac6e1d5 req-dc86635a-371d-49fc-a0df-3ab6a2c0756f tempest-ServerMetadataNegativeTestJSON-2090714491 tempest-ServerMetadataNegativeTestJSON-2090714491-project-member] Enqueued Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 881.561364] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGHEST for action security_group_members [ 881.561364] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.561364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.561364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.561660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.561660] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.561734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.561805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.561923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.562014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.562182] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.064820] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.064820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.064820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.065264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.065264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.065403] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.065539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.065633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.065848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.065963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.066389] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 is going to be updated. [ 882.101086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.101246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.101618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.101618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.101722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.112047] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: IN_PROGRESS for 2s [ 882.641993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 882.642221] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 882.643051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.390760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: SUCCESS [ 883.391074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.125681] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d885f9be-7315-49b0-bdb6-9777836ebd30 in Status: SUCCESS [ 884.125681] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 deletion is rescheduled due to dependency. [ 884.125681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.412533] env[65443]: INFO networking_nsxv3.common.synchronization [req-c2c11ee9-14d4-4fd2-9dff-afc9b6c01489 req-9030a1da-3a0c-4e98-b5e1-d797058abe3a tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 886.413092] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 886.413444] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.413581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.413656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.413997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.414049] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.414148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.414400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.414400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.414506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.414537] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.783250] env[65443]: INFO networking_nsxv3.common.synchronization [req-d02c2434-8b44-438b-b43f-43c90b25dbaa req-181d5b4d-1dca-4483-88a9-24fafdfc09c9 tempest-ListServerFiltersTestJSON-546799938 tempest-ListServerFiltersTestJSON-546799938-project-member] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 886.783576] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGHEST for action security_group_members [ 886.784205] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.784205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.784205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.784380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.784434] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.784570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.785734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.785734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.785734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.785734] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.816442] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.816598] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.816737] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.817080] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.817378] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.817635] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.817698] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.818596] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.818596] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.818596] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.818596] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.818596] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.818596] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.819556] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.819556] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.819556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.846026] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.846026] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.846026] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.846026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.846026] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-8b82e23a-768c-4136-b9c9-1773922d9e5a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.846026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.846026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.846975] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.847297] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b82e23a-768c-4136-b9c9-1773922d9e5a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.917154] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.290521] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.290521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.290521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.290521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.311901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.312184] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.312311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.312381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.312591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.312672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.312765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be updated. [ 887.343647] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.343864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.343985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.344313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.344538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.351434] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.351745] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.351948] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.352359] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.352592] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.352835] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 8b82e23a-768c-4136-b9c9-1773922d9e5a not found, creating... [ 887.353309] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.353588] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.353781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.354154] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.354398] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.354881] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.355592] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.355592] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.355775] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.356217] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.356217] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 8b82e23a-768c-4136-b9c9-1773922d9e5a is going to be created. [ 887.358721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: IN_PROGRESS for 2s [ 887.380559] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.380828] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.381017] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.381433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.381787] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.382147] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.420844] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.925518] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.925686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.925762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.925966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.926066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.926291] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 887.959390] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.959390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.959390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.959390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.959390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.970805] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 888.112055] env[65443]: INFO networking_nsxv3.common.synchronization [req-c2c11ee9-14d4-4fd2-9dff-afc9b6c01489 req-6764a89b-f4ff-41bd-bace-7bae9e5bb5be service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 888.112165] env[65443]: INFO networking_nsxv3.common.synchronization [req-c2c11ee9-14d4-4fd2-9dff-afc9b6c01489 req-6764a89b-f4ff-41bd-bace-7bae9e5bb5be service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 888.112287] env[65443]: INFO networking_nsxv3.common.synchronization [req-c2c11ee9-14d4-4fd2-9dff-afc9b6c01489 req-6764a89b-f4ff-41bd-bace-7bae9e5bb5be service nova] Enqueued Resource ID: 8b82e23a-768c-4136-b9c9-1773922d9e5a with Priority: HIGHEST for action port [ 888.112917] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 888.113059] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 888.113368] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b82e23a-768c-4136-b9c9-1773922d9e5a with Priority: HIGHEST for action port [ 888.113522] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.113632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.114109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.114109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.114109] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.115081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.115081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.117794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b82e23a-768c-4136-b9c9-1773922d9e5a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.117794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.117794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.117794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.117794] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b82e23a-768c-4136-b9c9-1773922d9e5a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.428336] env[65443]: INFO networking_nsxv3.common.synchronization [req-58f9ed84-985e-47d5-be51-ed6150677081 req-6e8cec0b-7e6c-44fb-b59c-a142e3440753 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 888.428545] env[65443]: INFO networking_nsxv3.common.synchronization [req-58f9ed84-985e-47d5-be51-ed6150677081 req-6e8cec0b-7e6c-44fb-b59c-a142e3440753 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 888.428714] env[65443]: INFO networking_nsxv3.common.synchronization [req-58f9ed84-985e-47d5-be51-ed6150677081 req-6e8cec0b-7e6c-44fb-b59c-a142e3440753 tempest-SecurityGroupsTestJSON-392670868 tempest-SecurityGroupsTestJSON-392670868-project-member] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 888.429364] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGHEST for action security_group_members [ 888.429523] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGHEST for action security_group_members [ 888.429641] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGHEST for action security_group_members [ 888.429987] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.430151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.430242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.430595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.430801] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.430933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.431027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.431242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.431357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.431483] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.432559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.432697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.432785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.432976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.433295] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.433295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.433415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.433546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.433648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.433768] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.434743] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.434876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.434963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.435163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.435341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.435461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.435565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.435729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.435828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.435936] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.617794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.618030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.619311] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8b82e23a-768c-4136-b9c9-1773922d9e5a with status ACTIVE [ 888.619830] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.621542] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.621542] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.621542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.621542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8b82e23a-768c-4136-b9c9-1773922d9e5a is going to be updated. [ 888.645034] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.645034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.645034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.645034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.645034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.645034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b82e23a-768c-4136-b9c9-1773922d9e5a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.937554] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.937724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.937773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.938033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.939232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.939342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.939566] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.939683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.958811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.958811] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.959073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.959073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.959210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.959292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.959481] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be updated. [ 888.960471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.960650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.982975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.983331] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.983469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.983536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.983740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.984257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.984257] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be updated. [ 888.984899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.985097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.998727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.998935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.998935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.999144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.999403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.010928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: IN_PROGRESS for 2s [ 889.013964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.014244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.014900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.014900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.014900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.014900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.014900] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be updated. [ 889.032922] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.033078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.033136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.033368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.033502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.044187] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: IN_PROGRESS for 2s [ 889.060702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.060823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.060882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.061120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.061295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.071121] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: IN_PROGRESS for 2s [ 889.108332] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-6592da6c-3b26-4c4f-9a07-3f5813059ca7 tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 889.108757] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 889.109924] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.110087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.110158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.110375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.110699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.110809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.110898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.111089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.111247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.111318] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.374998] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 in Status: SUCCESS [ 889.375234] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 deletion is rescheduled due to dependency. [ 889.375406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.565086] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.565388] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.565443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.565678] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.569719] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.569899] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.570035] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.570287] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.570438] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.570651] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.570762] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.570870] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.570975] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.571108] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.571216] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.571344] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.590437] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.590659] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.590925] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.591166] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.591566] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-d4e2be09-1d0f-477c-ac08-80715774642a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.591787] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.591924] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.592340] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.592511] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4e2be09-1d0f-477c-ac08-80715774642a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.613765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.613978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.614092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.614350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.614445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.614641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.614740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.614804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.615025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.615143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.615257] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be deleted. [ 889.650668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.650668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.650668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.651147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.651147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.651147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.984849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 889.985259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.985342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.985503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.985694] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.985809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.986235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.986235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.986235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.986374] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.096313] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.096714] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.097143] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.097530] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.097914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.098365] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port d4e2be09-1d0f-477c-ac08-80715774642a not found, creating... [ 890.098914] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.099251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.099527] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.099971] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.100797] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.100797] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.101100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.101551] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.101968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.102299] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.102531] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: d4e2be09-1d0f-477c-ac08-80715774642a is going to be created. [ 890.131261] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.131536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.131536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.131852] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.132165] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.132479] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.489258] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.826146] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-2ac6ba86-d6e3-456f-82be-f8b2e73c4ad2 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 890.826146] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-2ac6ba86-d6e3-456f-82be-f8b2e73c4ad2 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 890.826146] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-2ac6ba86-d6e3-456f-82be-f8b2e73c4ad2 service nova] Enqueued Resource ID: d4e2be09-1d0f-477c-ac08-80715774642a with Priority: HIGHEST for action port [ 890.828149] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 890.828149] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 890.828149] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4e2be09-1d0f-477c-ac08-80715774642a with Priority: HIGHEST for action port [ 890.830503] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.833357] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.833357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.833357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.833822] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.834046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.834311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.834586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.834958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.835187] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.836335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4e2be09-1d0f-477c-ac08-80715774642a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.836702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.837218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.840271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.840271] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4e2be09-1d0f-477c-ac08-80715774642a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.991069] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.047577] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc in Status: SUCCESS [ 891.047787] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc deletion is rescheduled due to dependency. [ 891.047884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.079932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 in Status: SUCCESS [ 891.079932] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 deletion is rescheduled due to dependency. [ 891.079932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.082137] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f in Status: SUCCESS [ 891.082137] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f deletion is rescheduled due to dependency. [ 891.082275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.342109] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.343285] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.343437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.343630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4e2be09-1d0f-477c-ac08-80715774642a with status ACTIVE [ 891.343769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.344848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.344997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.345312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.345312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.345668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.345668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.345668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.346221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.346221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.346221] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.346221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.346364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.346876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.346945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.347058] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4e2be09-1d0f-477c-ac08-80715774642a is going to be updated. [ 891.376837] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.377053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.377053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.377261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.377397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.377557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4e2be09-1d0f-477c-ac08-80715774642a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.493584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.493779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.493823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.494366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.494366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.494366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 891.539261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.539400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.539476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.539782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.539838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.561350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 891.849994] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.871461] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-17207d5c-a1bd-43b3-9b92-eca2ef64ec44 tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 891.874683] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 891.875088] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.875181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.211527] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-618 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.211729] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.211866] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.212222] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.212480] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.212638] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.212936] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.212983] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.213404] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.213661] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.213782] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.213891] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.213996] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.214117] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.214223] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.214384] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.234840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.235017] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.235148] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.235323] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-618" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.235842] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-6166f5e7-62a1-4453-89c4-6f64dbb9313b taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.235842] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.235981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.236325] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.236511] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6166f5e7-62a1-4453-89c4-6f64dbb9313b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.353216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.354127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.354127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.354127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.354127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.354127] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be created. [ 892.383200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.383447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.383447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.383695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.383839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.396524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: UNINITIALIZED for 2s [ 892.740892] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.741146] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.741303] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.741585] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.741742] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.741894] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 6166f5e7-62a1-4453-89c4-6f64dbb9313b not found, creating... [ 892.742163] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.742319] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.742435] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.742643] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.742777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.743058] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.743211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.743353] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.743559] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.743688] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.743823] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 6166f5e7-62a1-4453-89c4-6f64dbb9313b is going to be created. [ 892.769203] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.769203] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.769203] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.769203] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.769568] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.770369] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.569018] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-366411d2-5e0d-4610-9a9c-f9e2fa73c734 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 893.569339] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-366411d2-5e0d-4610-9a9c-f9e2fa73c734 service nova] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 893.569442] env[65443]: INFO networking_nsxv3.common.synchronization [req-6ebd91a3-09db-4db1-8f4f-3954add88399 req-366411d2-5e0d-4610-9a9c-f9e2fa73c734 service nova] Enqueued Resource ID: 6166f5e7-62a1-4453-89c4-6f64dbb9313b with Priority: HIGHEST for action port [ 893.571173] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_rules [ 893.571399] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 893.571526] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6166f5e7-62a1-4453-89c4-6f64dbb9313b with Priority: HIGHEST for action port [ 893.571812] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.571916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.572145] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.572215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.572381] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6166f5e7-62a1-4453-89c4-6f64dbb9313b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.572507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.572550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.572730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.572809] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6166f5e7-62a1-4453-89c4-6f64dbb9313b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.574492] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 893.574754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.575339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.575624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.575883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.576247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.576247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.576326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.576411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.576439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.576568] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.078278] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6166f5e7-62a1-4453-89c4-6f64dbb9313b with status ACTIVE [ 894.078506] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.078643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.078714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.078924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.079025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.079196] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.079296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.079362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.079517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.079570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.079753] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.080102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.080179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.080336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.080399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.080472] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6166f5e7-62a1-4453-89c4-6f64dbb9313b is going to be updated. [ 894.081692] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.081814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.081866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.082030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.082174] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.082269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.082332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.082481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.082572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.082632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.082769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.082858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.082918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.083070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.083204] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.083371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.083442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.083631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.083661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.083727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.083873] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.109740] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.109740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.109740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.109740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.109740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.109740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6166f5e7-62a1-4453-89c4-6f64dbb9313b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.407142] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 894.407354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.407558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.407836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.408061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.408190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.408254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.408415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.408499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.408622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.408683] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.410281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.410569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.410777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.410908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.410975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.411189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.411264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.411352] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.587788] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 894.607324] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.607535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.607584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.607821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.630850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.631177] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.631306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.631374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.631569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.631651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.631839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.631938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.632008] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.632167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.632240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.632418] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.632626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.632691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.636020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.636020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.636020] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 894.679171] env[65443]: INFO networking_nsxv3.common.synchronization [req-dbc2d528-7ac5-4149-97f8-b2a7389a3d81 req-42f28fe8-cc32-42c8-9f7b-897ff9624967 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 894.679171] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 894.680124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.680245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.680312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.680567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.680730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.680828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.680887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.681047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.681127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.681228] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.703911] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.704245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.704245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.704425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.704575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.723027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 894.911793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.911793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.913521] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.098199] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.098397] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.098519] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.098776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.099034] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.099190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.099311] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.099515] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.099663] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.101237] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.101442] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.101565] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.101683] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.101800] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.101906] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.102095] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.125482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.125694] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.125807] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.126055] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.126505] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.126745] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.126916] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.127417] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.127618] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2c6e1da-1cb3-458a-8d87-edf2e15505b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.183220] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.183549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.183675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.183820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.183916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.184152] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.184289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.184369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.184564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.184656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.184746] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c155a28-d058-4976-8391-4c7cb25222de already deleted. [ 895.184888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.419694] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.629955] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.630387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.630387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.630586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.630732] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.630881] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d2c6e1da-1cb3-458a-8d87-edf2e15505b3 not found, creating... [ 895.631169] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.631325] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.631444] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.631666] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.631799] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.632093] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.632280] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.632367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.632585] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.633056] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.633056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d2c6e1da-1cb3-458a-8d87-edf2e15505b3 is going to be created. [ 895.659749] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.659971] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.660151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.660433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.660661] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.660911] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.923721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.923721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.923721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.923721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.923721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.923721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 895.957364] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.957549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.957609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.957793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.957951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.969556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 896.424763] env[65443]: INFO networking_nsxv3.common.synchronization [req-dbc2d528-7ac5-4149-97f8-b2a7389a3d81 req-acdb9a6a-4304-4201-a446-74c39d3c42db service nova] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 896.424942] env[65443]: INFO networking_nsxv3.common.synchronization [req-dbc2d528-7ac5-4149-97f8-b2a7389a3d81 req-acdb9a6a-4304-4201-a446-74c39d3c42db service nova] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 896.425461] env[65443]: INFO networking_nsxv3.common.synchronization [req-dbc2d528-7ac5-4149-97f8-b2a7389a3d81 req-acdb9a6a-4304-4201-a446-74c39d3c42db service nova] Enqueued Resource ID: d2c6e1da-1cb3-458a-8d87-edf2e15505b3 with Priority: HIGHEST for action port [ 896.425805] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_rules [ 896.425960] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 896.426449] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2c6e1da-1cb3-458a-8d87-edf2e15505b3 with Priority: HIGHEST for action port [ 896.426593] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.427369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.427474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.427695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.427783] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.429917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.429986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.430047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.430226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.430385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.430487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.430544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.430691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.430776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.430895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.434463] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.434463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.434463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.434463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.434463] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2c6e1da-1cb3-458a-8d87-edf2e15505b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.737108] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 896.737439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.935043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.935264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.938527] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.939926] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2c6e1da-1cb3-458a-8d87-edf2e15505b3 with status ACTIVE [ 896.940175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.940306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.940379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.940615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.940706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.940899] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.941023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.941097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.941319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.941426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.941614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.941708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.941768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.941909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.941983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.942198] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2c6e1da-1cb3-458a-8d87-edf2e15505b3 is going to be updated. [ 896.969060] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.970510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.970510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.970510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.970510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.970510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2c6e1da-1cb3-458a-8d87-edf2e15505b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.444984] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.950999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.950999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.950999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.950999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.950999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.950999] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c155a28-d058-4976-8391-4c7cb25222de is going to be created. [ 897.975362] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.975528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.975628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.975808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.975959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.987287] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 897.987503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.987670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.987884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.988067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.988183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.988243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.988392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.988473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.988572] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.990185] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: UNINITIALIZED for 2s [ 898.491746] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.996519] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.500794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.501048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.501124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.501453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.501560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.501686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 899.545886] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.545886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.545886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.546139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.546139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.559115] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 900.002424] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: SUCCESS [ 900.002744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.002864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.003193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.003465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.003641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.003720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.003888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.003972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.004074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.004173] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.484266] env[65443]: INFO networking_nsxv3.common.synchronization [None req-fcfcdcfb-1037-4e43-aa3a-5719dbd22397 None None] Enqueued Resource ID: 0eb4f54f-0171-4dba-b355-2e2176a2e087 with Priority: HIGHEST for action port [ 900.486898] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0eb4f54f-0171-4dba-b355-2e2176a2e087 with Priority: HIGHEST for action port [ 900.486898] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0eb4f54f-0171-4dba-b355-2e2176a2e087 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.486898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0eb4f54f-0171-4dba-b355-2e2176a2e087" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.486898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0eb4f54f-0171-4dba-b355-2e2176a2e087" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.486898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0eb4f54f-0171-4dba-b355-2e2176a2e087" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.486898] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0eb4f54f-0171-4dba-b355-2e2176a2e087',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.506897] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.993126] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0eb4f54f-0171-4dba-b355-2e2176a2e087 [ 900.993431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.994855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.994855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.994855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.994855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.994855] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0eb4f54f-0171-4dba-b355-2e2176a2e087 already deleted. [ 900.994855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0eb4f54f-0171-4dba-b355-2e2176a2e087" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.012609] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4c155a28-d058-4976-8391-4c7cb25222de: rpc.has_security_group_logging(os_id): False [ 901.034261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.036286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.036397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.036610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.036708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.036983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.037116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.037190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.037379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.037462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.037558] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c155a28-d058-4976-8391-4c7cb25222de is going to be created. [ 901.140850] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.141642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.141642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.141642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.141642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.158122] env[65443]: INFO networking_nsxv3.common.synchronization [req-9d5a338f-5b9f-4f6a-a2dc-1d7827e6f93f req-8c6ba657-c37e-4b87-96cb-305831299c94 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 901.158223] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 901.159289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.159289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.159289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.159725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.159725] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.169373] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: IN_PROGRESS for 2s [ 901.568981] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 901.569215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.569388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.569782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.569782] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.569906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.569982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.570117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.570192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.570449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.570449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.570532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.570562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.571243] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.571243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.571560] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.663551] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.665154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.665235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.665520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.665610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.665835] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.665942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.666011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.666165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.666247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.666333] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 901.695628] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.695946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.696373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.696675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.696868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.708506] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 902.075071] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a21b1b0-a493-4718-8c01-ec2d54222333: rpc.has_security_group_logging(os_id): False [ 902.094465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.094878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.094878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.095033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.095033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.095475] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.095574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.095574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.095805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.095874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.096107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.097058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.097058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.097058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.097058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.097058] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.097058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.097438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.097621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.097810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.098001] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be created. [ 902.167766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.167766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.167922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.168147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.168377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.184534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 903.109716] env[65443]: INFO networking_nsxv3.common.synchronization [None req-bfa6c207-05fa-4e7d-bace-99feeec2992b None None] Enqueued Resource ID: 2a7f425b-d758-4cd5-9938-abdbf5343ccb with Priority: HIGHEST for action port [ 903.110216] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a7f425b-d758-4cd5-9938-abdbf5343ccb with Priority: HIGHEST for action port [ 903.110881] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a7f425b-d758-4cd5-9938-abdbf5343ccb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.112009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a7f425b-d758-4cd5-9938-abdbf5343ccb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.112180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a7f425b-d758-4cd5-9938-abdbf5343ccb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.114207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a7f425b-d758-4cd5-9938-abdbf5343ccb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.114952] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a7f425b-d758-4cd5-9938-abdbf5343ccb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.181663] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: SUCCESS [ 903.183030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.584636] env[65443]: INFO networking_nsxv3.common.synchronization [None req-722f0fbe-d257-49c5-b975-4cfc3e1d038a None None] Enqueued Resource ID: 60b4712c-85b3-41de-a8f0-04482270c2f0 with Priority: HIGHEST for action port [ 903.586104] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60b4712c-85b3-41de-a8f0-04482270c2f0 with Priority: HIGHEST for action port [ 903.587355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-60b4712c-85b3-41de-a8f0-04482270c2f0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.587355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60b4712c-85b3-41de-a8f0-04482270c2f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.587355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60b4712c-85b3-41de-a8f0-04482270c2f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.587355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60b4712c-85b3-41de-a8f0-04482270c2f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.587355] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60b4712c-85b3-41de-a8f0-04482270c2f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.616034] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a7f425b-d758-4cd5-9938-abdbf5343ccb [ 903.616293] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.616662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.616662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.616931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.616931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.616931] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a7f425b-d758-4cd5-9938-abdbf5343ccb already deleted. [ 903.617135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a7f425b-d758-4cd5-9938-abdbf5343ccb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.719961] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 903.719961] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 903.719961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.089648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60b4712c-85b3-41de-a8f0-04482270c2f0 [ 904.089975] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.090186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.090262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.090531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.090637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.090742] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60b4712c-85b3-41de-a8f0-04482270c2f0 already deleted. [ 904.091530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60b4712c-85b3-41de-a8f0-04482270c2f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.205375] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 904.205375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.205375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.205859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.205859] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.710076] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.710076] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.710076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.710076] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.215112] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.215463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.215463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.215601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.215775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.215888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.215957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.216185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.220016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.220016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.220016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.220016] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.723790] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a21b1b0-a493-4718-8c01-ec2d54222333: rpc.has_security_group_logging(os_id): False [ 905.747286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.747436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.747501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.747710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.747798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.747976] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.748151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.748151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.748290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.748365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.748553] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.748646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.748704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.748837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.748909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.749206] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.749305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.749387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.749507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.749583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.749666] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 905.821975] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.821975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.821975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.822228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.822228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.841928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 906.134085] env[65443]: INFO networking_nsxv3.common.synchronization [req-48ad8529-38f1-4ba0-9cf1-91a2f5b050f7 req-643ecd3a-25f0-4535-a10a-0bd85eef0a89 tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 906.134195] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 906.134598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.135286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.135418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.135507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.135687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.135869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.135933] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.220433] env[65443]: INFO networking_nsxv3.common.synchronization [None req-5001500d-2191-481e-a1b0-1f5043a1b260 None None] Enqueued Resource ID: 82c4a39a-d13d-4e54-aaa8-529c6a3652ff with Priority: HIGHEST for action port [ 906.220691] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c4a39a-d13d-4e54-aaa8-529c6a3652ff with Priority: HIGHEST for action port [ 906.220974] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c4a39a-d13d-4e54-aaa8-529c6a3652ff taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.221220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c4a39a-d13d-4e54-aaa8-529c6a3652ff" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.221306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c4a39a-d13d-4e54-aaa8-529c6a3652ff" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.221593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c4a39a-d13d-4e54-aaa8-529c6a3652ff" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.221731] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c4a39a-d13d-4e54-aaa8-529c6a3652ff',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.454117] env[65443]: INFO networking_nsxv3.common.synchronization [req-12e6258f-67ff-4fd1-ba76-c62dc015cebd req-bbef73c6-d124-4598-8263-c9444531be86 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 906.454670] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 906.454982] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.455578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.455689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.455995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.456114] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.456254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.456458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.456546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.456595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.456707] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.565024] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7edac169-b491-4939-9318-278a425ed9e4 None None] Enqueued Resource ID: ee389a38-1db6-4e61-a9c5-bfde93447669 with Priority: HIGHEST for action port [ 906.565024] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee389a38-1db6-4e61-a9c5-bfde93447669 with Priority: HIGHEST for action port [ 906.565024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee389a38-1db6-4e61-a9c5-bfde93447669 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.565024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee389a38-1db6-4e61-a9c5-bfde93447669" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.565024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee389a38-1db6-4e61-a9c5-bfde93447669" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.565024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee389a38-1db6-4e61-a9c5-bfde93447669" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.565024] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee389a38-1db6-4e61-a9c5-bfde93447669',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.639050] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.714678] env[65443]: INFO networking_nsxv3.common.synchronization [req-0bc2f110-0a70-44e9-a0c2-6dd68af71c31 req-fd23e46b-332f-4310-b250-b9657a743439 tempest-FloatingIPsAssociationNegativeTestJSON-2092950691 tempest-FloatingIPsAssociationNegativeTestJSON-2092950691-project-member] Enqueued Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 906.716324] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGHEST for action security_group_members [ 906.716680] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.716839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.716920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.717180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.717368] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.717575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.717774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.717877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.717983] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.723134] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 82c4a39a-d13d-4e54-aaa8-529c6a3652ff [ 906.723520] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.723724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.723854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.724520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.724717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.725045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:82c4a39a-d13d-4e54-aaa8-529c6a3652ff already deleted. [ 906.725260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c4a39a-d13d-4e54-aaa8-529c6a3652ff" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.958946] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.065718] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee389a38-1db6-4e61-a9c5-bfde93447669 [ 907.065890] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.066042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.066149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.066335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.066437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.066661] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee389a38-1db6-4e61-a9c5-bfde93447669 already deleted. [ 907.066728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee389a38-1db6-4e61-a9c5-bfde93447669" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.141489] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.220185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.221467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.221467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.221467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.221467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.221467] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.221880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.221880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.221880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.221880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.222017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a is going to be updated. [ 907.255870] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.256753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.256873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.257219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.258036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.267931] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: IN_PROGRESS for 2s [ 907.461435] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.645965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.648031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.648031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.648031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.648031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.648031] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 907.680534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.680534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.680534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.680534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.680534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.690738] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 907.705953] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7340161e-051b-4a74-a200-2b8f03a386c1 None None] Enqueued Resource ID: 6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac with Priority: HIGHEST for action port [ 907.707073] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac with Priority: HIGHEST for action port [ 907.707528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.708403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.708574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.708859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.708951] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.861612] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 907.861612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.907400] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0d2065-3e6d-4f59-a3d3-0906fbaac7ee req-3e75adce-e1af-4650-940f-cf352b4ede2b tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 907.910706] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 907.910706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.910706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.910706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.913306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.913306] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.913306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.913306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.913306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.913306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.913306] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.964075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.964232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.964301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.964591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.964690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.964802] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 907.997976] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.997976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.997976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.997976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.997976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.006607] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 908.211455] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac [ 908.211757] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.211923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.212025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.212299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.212412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.212539] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac already deleted. [ 908.212647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6947d00a-f73a-4b5d-ad4a-e2e04c4e19ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.366178] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d584165-0f04-4037-889e-239d7e1bff58 req-d272032e-8c71-4192-b83b-6fa31a36939e tempest-ServerTagsTestJSON-1535616916 tempest-ServerTagsTestJSON-1535616916-project-member] Enqueued Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 908.366792] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 908.367137] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.367737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.367737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.367737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.367737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.368077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.368077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.368077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.369077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.369077] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.415986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.416179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.416254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.416517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.416517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.417086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.417086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.417086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.417086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.417086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.417492] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 already deleted. [ 908.417492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.436067] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.436153] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.436239] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.436496] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.436786] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.436968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.437117] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.437469] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.437469] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.437672] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.437784] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.437890] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.437993] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.438128] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.438235] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.438365] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.461400] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 908.461600] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 908.461705] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 908.461877] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.462218] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.462372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.462529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.462944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.463142] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.870575] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.870752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.870796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.871034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.871121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.871355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.871410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.871481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.871605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.871678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.871767] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed02cbf-524b-4807-91ae-649fc532249a already deleted. [ 908.871846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.966522] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.967392] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.967527] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.969162] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 not found, creating... [ 908.969162] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.969162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.969741] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.969741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.969741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.969741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.970100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.970100] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 is going to be created. [ 908.987974] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-725 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.988173] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-725" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.988296] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-725" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.988615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-725" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.988869] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.989225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.989391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.989682] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.989841] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.990060] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.990174] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 908.990280] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 908.990386] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 908.990493] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 908.990594] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 908.990727] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 908.995964] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.996183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.996283] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.996556] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.996776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.996996] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.009906] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 909.010117] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 909.010299] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 909.010967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-725" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.010967] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.010967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.011200] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.011370] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.011506] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.278314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a in Status: SUCCESS [ 909.278490] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a deletion is rescheduled due to dependency. [ 909.278592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.344393] env[65443]: INFO networking_nsxv3.common.synchronization [None req-bed2a720-6c76-4a8b-8798-2a71f4e9997a None None] Enqueued Resource ID: 2dc15289-dc07-428c-a2a6-0ea405303001 with Priority: HIGHEST for action port [ 909.344957] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dc15289-dc07-428c-a2a6-0ea405303001 with Priority: HIGHEST for action port [ 909.345277] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dc15289-dc07-428c-a2a6-0ea405303001 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.345400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dc15289-dc07-428c-a2a6-0ea405303001" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.345469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dc15289-dc07-428c-a2a6-0ea405303001" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.345766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dc15289-dc07-428c-a2a6-0ea405303001" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.345871] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dc15289-dc07-428c-a2a6-0ea405303001',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.513902] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.514315] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.514617] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.514914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.515085] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.515250] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 not found, creating... [ 909.515523] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.515702] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.515838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.516206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.516335] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.516533] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.516691] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.516808] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.517031] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.517168] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.517307] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 is going to be created. [ 909.548318] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.548544] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.548631] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.548910] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.549158] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.549381] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.695601] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0d2065-3e6d-4f59-a3d3-0906fbaac7ee req-e48f7e83-a1c6-4f84-9497-aab2ced2c408 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 909.695601] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0d2065-3e6d-4f59-a3d3-0906fbaac7ee req-e48f7e83-a1c6-4f84-9497-aab2ced2c408 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 909.695601] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac0d2065-3e6d-4f59-a3d3-0906fbaac7ee req-e48f7e83-a1c6-4f84-9497-aab2ced2c408 service nova] Enqueued Resource ID: dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 with Priority: HIGHEST for action port [ 909.695853] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 909.695948] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 909.696533] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 with Priority: HIGHEST for action port [ 909.697438] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.697438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.697438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.697438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.697438] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.698322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.698878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.698878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.699062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.699234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.699341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.699404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.699588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.699704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.699805] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.702332] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.702487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.702584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.702837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.702946] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.704903] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 909.705179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.849156] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dc15289-dc07-428c-a2a6-0ea405303001 [ 909.849156] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.849156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.849156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.849156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.849156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.849156] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dc15289-dc07-428c-a2a6-0ea405303001 already deleted. [ 909.849156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dc15289-dc07-428c-a2a6-0ea405303001" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.017213] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 910.017368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.202886] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.206369] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.206509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.206745] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 with status ACTIVE [ 910.206940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.207066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.207150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.207426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.207532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.207833] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.207894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.207993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.208300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.208422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.208622] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.208725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.208790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.208948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.209057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.209193] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29 is going to be updated. [ 910.247664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.247664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.247664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.247664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.247664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.247664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dde3fa85-2f5d-4ff1-a4a5-4672b1a7ac29" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.274740] env[65443]: INFO networking_nsxv3.common.synchronization [req-a83cfeeb-1cbd-4718-980c-50a251f5d463 req-9f915241-b454-43be-96f8-8034aa296ccc tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 910.274740] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 910.275510] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.275642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.275706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.275913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.276086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.276184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.276245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.276393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.276504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.276651] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.296740] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d584165-0f04-4037-889e-239d7e1bff58 req-568912be-7425-46b3-90b4-49af05fc0ac0 service nova] Enqueued Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_rules [ 910.296740] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d584165-0f04-4037-889e-239d7e1bff58 req-568912be-7425-46b3-90b4-49af05fc0ac0 service nova] Enqueued Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 910.296740] env[65443]: INFO networking_nsxv3.common.synchronization [req-6d584165-0f04-4037-889e-239d7e1bff58 req-568912be-7425-46b3-90b4-49af05fc0ac0 service nova] Enqueued Resource ID: 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 with Priority: HIGHEST for action port [ 910.297117] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_rules [ 910.297257] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 910.297352] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 with Priority: HIGHEST for action port [ 910.297667] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.297796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.297860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.298694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.298812] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.300302] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.300577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.300577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.301060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.301243] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.301322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.301385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.301548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.301615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.301708] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.303195] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.303287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.303379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.305221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.305322] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.618265] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-310 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.618583] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.618583] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.618848] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.619217] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.619560] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.619560] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.619815] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.619979] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.620190] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.620389] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.620475] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.620583] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.620847] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.620847] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.620941] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.627672] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4098a12e-3ddc-439e-8099-68c57c96c372 None None] Enqueued Resource ID: d465bb84-64c4-4aee-b3da-04a1feef530d with Priority: HIGHEST for action port [ 910.628181] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d465bb84-64c4-4aee-b3da-04a1feef530d with Priority: HIGHEST for action port [ 910.628479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d465bb84-64c4-4aee-b3da-04a1feef530d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.628593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d465bb84-64c4-4aee-b3da-04a1feef530d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.628662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d465bb84-64c4-4aee-b3da-04a1feef530d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.628897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d465bb84-64c4-4aee-b3da-04a1feef530d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.628975] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d465bb84-64c4-4aee-b3da-04a1feef530d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.642626] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.642821] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.642958] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.643152] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-310" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.643504] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.643672] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.643786] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.644119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.644258] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b1e25f1-01c1-49e8-81d2-d68e6e2b077f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.705629] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.780044] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.780044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.780044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.780044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.801037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.801037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.801037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.801037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.801326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.801326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.801326] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 910.802754] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.802912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.808547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 with status ACTIVE [ 910.808746] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.808863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.808931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.809147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.809232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.809399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.809496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.809556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.809709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.809785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.809960] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.810065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.810126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.810260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.810332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.810518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8 is going to be updated. [ 910.811703] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.835388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.835388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.835388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.835541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.835541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.837473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.837613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.837673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.837842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.837963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.838125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e43a8b7-b414-460e-9ffa-92ffd5ae4fd8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.846643] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 911.131650] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d465bb84-64c4-4aee-b3da-04a1feef530d [ 911.132593] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.132750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.132822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.133090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.133171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.133275] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d465bb84-64c4-4aee-b3da-04a1feef530d already deleted. [ 911.133375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d465bb84-64c4-4aee-b3da-04a1feef530d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.146371] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.146588] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.146672] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.147015] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.147197] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.147376] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f not found, creating... [ 911.147686] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.147865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.147976] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.148190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.148324] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.148618] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.148773] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.148910] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.149242] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.149400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.149541] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f is going to be created. [ 911.173558] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.173854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.174040] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.174448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.174754] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.175070] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.208676] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.208855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.208922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.209140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.209230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.209327] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be created. [ 911.248738] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.249394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.249394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.249394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.249394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.265600] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: UNINITIALIZED for 2s [ 911.317043] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.819899] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.820299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.820299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.820369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.820489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.820613] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed02cbf-524b-4807-91ae-649fc532249a is going to be created. [ 911.851473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.851566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.851566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.853371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.853371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.865015] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: UNINITIALIZED for 2s [ 911.911344] env[65443]: INFO networking_nsxv3.common.synchronization [req-a83cfeeb-1cbd-4718-980c-50a251f5d463 req-1fda7aa1-d790-424e-a1f1-e0a45ee00cfa service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 911.914185] env[65443]: INFO networking_nsxv3.common.synchronization [req-a83cfeeb-1cbd-4718-980c-50a251f5d463 req-1fda7aa1-d790-424e-a1f1-e0a45ee00cfa service nova] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 911.914185] env[65443]: INFO networking_nsxv3.common.synchronization [req-a83cfeeb-1cbd-4718-980c-50a251f5d463 req-1fda7aa1-d790-424e-a1f1-e0a45ee00cfa service nova] Enqueued Resource ID: 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f with Priority: HIGHEST for action port [ 911.914185] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_rules [ 911.914185] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 911.914185] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f with Priority: HIGHEST for action port [ 911.914185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.914185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.914185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.914185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.914185] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.914959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.916095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.916095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.916095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.916095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.916095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.916890] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b1e25f1-01c1-49e8-81d2-d68e6e2b077f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.419916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.420076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.420309] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f with status ACTIVE [ 912.420456] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.420609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.420874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.421221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.421474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.421761] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.421925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.422040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.422293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.422424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.422720] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.422869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.422968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.424552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.424552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.424552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4b1e25f1-01c1-49e8-81d2-d68e6e2b077f is going to be updated. [ 912.450754] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.450967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.450967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.451182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.451322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.451512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b1e25f1-01c1-49e8-81d2-d68e6e2b077f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.857401] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 912.857646] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e deletion is rescheduled due to dependency. [ 912.857703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.857869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.858111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.858294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.858410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.858499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.858659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.858741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.858869] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.278506] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 913.278798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.278992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.279287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.279528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.280016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.280121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.280627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.280741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.280861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.280991] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.361469] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.784029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.785033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.785033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.785033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.785033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.785033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.785285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.785320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.785392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.785548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.785745] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.785845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.785928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.786126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.786295] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.786423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.786489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.786630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.786998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.786998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.786998] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.863950] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.874629] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: SUCCESS [ 913.874629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.875106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.875331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.875527] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.875640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.875744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.875917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.876014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.876109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.876199] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.290037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e276458-6ae4-4b43-8889-3fac24210880: rpc.has_security_group_logging(os_id): False [ 914.318818] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.318987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.319070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.319277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.319367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.319598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.319699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.319762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.319907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.319985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.320353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.320353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.320353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.320507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.320554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.320710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.320800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.320865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.321010] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.321089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.321174] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be created. [ 914.366394] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.366581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.366636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.366834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.366921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.367032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 914.378419] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.378665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.378764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.379079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.379334] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.379512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.379637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.379872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.379969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.380075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.380259] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.380410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.380517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.380732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.380961] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.381133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.381249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.381498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.381641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.381797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.381942] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.387379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.387499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.387568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.387761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.387932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.425356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.425515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.425515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.425784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.426450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.429938] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 914.440839] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 914.567514] env[65443]: INFO networking_nsxv3.common.synchronization [req-cf3e187a-9844-4a02-af29-fb17e0d832b1 req-0bbd265b-562c-44db-85b2-b936381785ca tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: cb90a7ef-c5bf-4936-b9a1-564aeda1237f with Priority: HIGHEST for action security_group_rules [ 914.568459] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb90a7ef-c5bf-4936-b9a1-564aeda1237f with Priority: HIGHEST for action security_group_rules [ 914.568572] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb90a7ef-c5bf-4936-b9a1-564aeda1237f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.568634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb90a7ef-c5bf-4936-b9a1-564aeda1237f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.568670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb90a7ef-c5bf-4936-b9a1-564aeda1237f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.568922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb90a7ef-c5bf-4936-b9a1-564aeda1237f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.569013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb90a7ef-c5bf-4936-b9a1-564aeda1237f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.884759] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ed02cbf-524b-4807-91ae-649fc532249a: rpc.has_security_group_logging(os_id): False [ 914.906861] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.906861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.906861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.906861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.907167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.907167] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.907246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.907290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.907441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.907512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.907677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.907765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.907823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.908027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.908185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.908580] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.908580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.908580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.908810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.909692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.909692] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ed02cbf-524b-4807-91ae-649fc532249a is going to be created. [ 915.050794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.050918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.050987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.051414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.051579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.065048] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: IN_PROGRESS for 2s [ 915.090564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.090722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.090822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.091041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.091076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.091236] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb90a7ef-c5bf-4936-b9a1-564aeda1237f already deleted. [ 915.091282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb90a7ef-c5bf-4936-b9a1-564aeda1237f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.449124] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 916.449597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.452481] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.455023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.455023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.455023] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.845740] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ca82cb4-5a2d-470c-af48-9371aea7fc73 req-1cdaaf3f-cab9-4287-b3b7-f5ef435e8908 tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: a2ee1cba-3fe7-49b7-827b-402fd0795dd4 with Priority: HIGHEST for action security_group_rules [ 916.846432] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2ee1cba-3fe7-49b7-827b-402fd0795dd4 with Priority: HIGHEST for action security_group_rules [ 916.846755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2ee1cba-3fe7-49b7-827b-402fd0795dd4 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.846932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2ee1cba-3fe7-49b7-827b-402fd0795dd4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.847000] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2ee1cba-3fe7-49b7-827b-402fd0795dd4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.849476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2ee1cba-3fe7-49b7-827b-402fd0795dd4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.849591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2ee1cba-3fe7-49b7-827b-402fd0795dd4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.957084] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.957329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.957433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.957677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.958096] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.958177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.958288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.958657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.958809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.959134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.959372] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.959596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.959705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.959990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.960278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.960355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.960468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.960676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.960797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.960926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.961072] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.081106] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: SUCCESS [ 917.081106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.285764] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ce616da-8458-4275-bb7a-29c4e3a9a0f7 req-02682090-393f-4559-bacc-1ee41ba2fa8c tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 917.286090] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 917.287107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.287720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.288066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.288828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.289087] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.289313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.289465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.289725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.289904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.290093] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.378483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.378483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.378483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.378483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.378483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.378483] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2ee1cba-3fe7-49b7-827b-402fd0795dd4 already deleted. [ 917.378483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2ee1cba-3fe7-49b7-827b-402fd0795dd4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.464989] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1004a68b-2190-4689-9601-8db71d48978e: rpc.has_security_group_logging(os_id): False [ 917.489447] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.489615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.489756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.489974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.490091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.490329] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.490464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.490512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.490663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.490747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.490947] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.491061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.491112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.491265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.491357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.491659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.491820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.491918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.492063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.492142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.492248] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 917.569978] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.570142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.570230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.570407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.570596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.642552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 917.662242] env[65443]: INFO networking_nsxv3.common.synchronization [req-b07989ec-64ee-4d5f-98d2-dbcdfda839d7 req-6d7782ba-bd67-44d5-a37d-dd118accc249 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 917.662242] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 917.662953] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.662953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.662953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.662953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.663585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.664017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.664129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.664311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.664407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.664515] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [req-b07989ec-64ee-4d5f-98d2-dbcdfda839d7 req-6d7782ba-bd67-44d5-a37d-dd118accc249 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [req-b07989ec-64ee-4d5f-98d2-dbcdfda839d7 req-6d7782ba-bd67-44d5-a37d-dd118accc249 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [req-b07989ec-64ee-4d5f-98d2-dbcdfda839d7 req-6d7782ba-bd67-44d5-a37d-dd118accc249 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 917.700054] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 917.700054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.700054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.700054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.700568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.700568] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.702600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72bf01a-5833-4162-b116-b877d61fef79 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.702600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.702600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.702875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.702875] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72bf01a-5833-4162-b116-b877d61fef79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.797097] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.924198] env[65443]: INFO networking_nsxv3.common.synchronization [req-da13e6cb-a7db-4188-a3f7-1adf208d6586 req-2f143313-3550-4a11-8085-c886c42c1f63 tempest-MultipleCreateTestJSON-669585566 tempest-MultipleCreateTestJSON-669585566-project-member] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 917.924762] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGHEST for action security_group_members [ 917.925315] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.925800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.167806] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.204443] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.204629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.205024] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d72bf01a-5833-4162-b116-b877d61fef79 with status ACTIVE [ 918.205024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.205184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.205184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.205383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.205936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.205936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.205936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.205936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.205936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.206198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.206198] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.206299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.206349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.206480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.206551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.206636] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d72bf01a-5833-4162-b116-b877d61fef79 is going to be updated. [ 918.233016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.233262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.233262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.233588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.233736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.233910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.299862] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.671945] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.809502] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.809761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.809761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.809928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.810036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.810140] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 918.849942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.850192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.850261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.850913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.851125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.862905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 918.957081] env[65443]: INFO networking_nsxv3.common.synchronization [req-6c57957b-986b-4f8a-9c35-1cb24685fecb req-072dfc7d-e99e-4173-85f0-b993f91c0ec1 tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: 394108af-4d7e-4296-84ee-e23f5933140b with Priority: HIGHEST for action security_group_rules [ 918.957705] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 394108af-4d7e-4296-84ee-e23f5933140b with Priority: HIGHEST for action security_group_rules [ 918.958132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-394108af-4d7e-4296-84ee-e23f5933140b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.958270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-394108af-4d7e-4296-84ee-e23f5933140b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.958340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-394108af-4d7e-4296-84ee-e23f5933140b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.958628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-394108af-4d7e-4296-84ee-e23f5933140b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.958723] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('394108af-4d7e-4296-84ee-e23f5933140b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.175182] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.175182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.175182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.175514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.175514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.175594] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 919.211683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.211868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.211918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.212171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.212326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.223960] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 919.488172] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.488625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.488625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.488625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.488729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.488758] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 394108af-4d7e-4296-84ee-e23f5933140b already deleted. [ 919.488858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-394108af-4d7e-4296-84ee-e23f5933140b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.664856] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 919.665038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.877482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 920.877840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.878040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.878216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.878415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.878541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.878606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.878760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.878844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.878949] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.256709] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 921.256932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.257167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.257300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.257498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.257611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.257695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.257834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.257972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.258085] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.381293] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.381539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.381613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.381885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.382015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.382288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.382795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.382795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.382795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.382910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.382979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be updated. [ 921.420222] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.420222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.420222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.420222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.420222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.428836] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: IN_PROGRESS for 2s [ 921.760638] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.865023] env[65443]: INFO networking_nsxv3.common.synchronization [req-23ecb213-02d7-4eab-8fa5-4f7ed67c8b54 req-1a8f581f-591e-4f02-a8d4-7611dabcca0b tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 921.865023] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 921.865832] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.865985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.881691] env[65443]: INFO networking_nsxv3.common.synchronization [req-23ecb213-02d7-4eab-8fa5-4f7ed67c8b54 req-1a8f581f-591e-4f02-a8d4-7611dabcca0b tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 921.882058] env[65443]: INFO networking_nsxv3.common.synchronization [req-23ecb213-02d7-4eab-8fa5-4f7ed67c8b54 req-1a8f581f-591e-4f02-a8d4-7611dabcca0b tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 921.882547] env[65443]: INFO networking_nsxv3.common.synchronization [req-23ecb213-02d7-4eab-8fa5-4f7ed67c8b54 req-1a8f581f-591e-4f02-a8d4-7611dabcca0b tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 921.883827] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_rules [ 921.884099] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 921.884252] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72bf01a-5833-4162-b116-b877d61fef79 with Priority: HIGHEST for action port [ 921.884602] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.884709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.884957] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.885058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.885240] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72bf01a-5833-4162-b116-b877d61fef79 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.885341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.885406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.885659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.885744] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72bf01a-5833-4162-b116-b877d61fef79',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.007721] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdc427-71e5-4869-97dd-eb30be41173e req-4d9f2324-9186-422d-b2f4-5a1775dd9c51 tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: 9690a005-d2bf-4960-8d5e-afd6810f629c with Priority: HIGHEST for action security_group_rules [ 922.008184] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9690a005-d2bf-4960-8d5e-afd6810f629c with Priority: HIGHEST for action security_group_rules [ 922.008496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9690a005-d2bf-4960-8d5e-afd6810f629c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.008617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9690a005-d2bf-4960-8d5e-afd6810f629c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.008683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9690a005-d2bf-4960-8d5e-afd6810f629c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.008935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9690a005-d2bf-4960-8d5e-afd6810f629c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.009035] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9690a005-d2bf-4960-8d5e-afd6810f629c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.265436] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.364780] env[65443]: INFO networking_nsxv3.common.synchronization [req-e01ec227-bb74-4b13-9f5a-095968298bd9 req-0c75921a-9613-4c42-8ec7-bd04b4336049 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 922.365455] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 922.365813] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.366455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.368148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.368432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.368659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.368799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.368881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.369070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.369197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.369320] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.392972] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d72bf01a-5833-4162-b116-b877d61fef79 with status ACTIVE [ 922.392972] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.392972] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.392972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.393903] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.394207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.394356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.394723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.394922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.395114] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d72bf01a-5833-4162-b116-b877d61fef79 is going to be updated. [ 922.422306] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.422306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.422306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.422306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.422306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.422306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72bf01a-5833-4162-b116-b877d61fef79" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.539500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.539626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.539734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.540032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.540132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.540233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9690a005-d2bf-4960-8d5e-afd6810f629c already deleted. [ 922.540324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9690a005-d2bf-4960-8d5e-afd6810f629c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.647312] env[65443]: INFO networking_nsxv3.common.synchronization [req-359696c5-60f3-428d-9b2f-0ae5f1854ccf req-2aad662e-9438-4088-9544-bdfc93b6de4b tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 922.648261] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 922.648409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.648567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.648641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.648848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.649011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.649115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.649178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.649325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.649411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.649507] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.767609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.767802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.769545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.769545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.769545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.769545] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 922.821769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.821957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.822100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.822417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.822653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.837231] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 922.872523] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.872822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.872942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.873276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.873414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.873770] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.873951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.874061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.874295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.874417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.874547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 922.906023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.906358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.906358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.906521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.906587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.919023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 923.081646] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.083039] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.083039] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.083039] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.086175] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.086405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.086562] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.086964] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.087033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.087241] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.087357] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.087468] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.087578] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.087686] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.087932] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.087932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.108333] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.108542] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.108684] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.108868] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.109258] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.109595] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.109595] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.112354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.112354] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9ecba6-b39f-435b-8456-5e77aa5b3e43',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.151767] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.442705] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 in Status: SUCCESS [ 923.442705] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 deletion is rescheduled due to dependency. [ 923.442907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.613279] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.613571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.613763] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.614259] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.614451] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.614636] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port eb9ecba6-b39f-435b-8456-5e77aa5b3e43 not found, creating... [ 923.615628] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.615628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.615628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.615628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.615628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.616128] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.616128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.616128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.616382] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.616450] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.616566] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: eb9ecba6-b39f-435b-8456-5e77aa5b3e43 is going to be created. [ 923.640164] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.640618] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.641139] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.641139] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.641335] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.641584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.655058] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.157053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.157453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.157453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.157453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.157553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.157583] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be updated. [ 924.193693] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.193909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.193962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.194289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.194482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.208148] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 924.384314] env[65443]: INFO networking_nsxv3.common.synchronization [req-e01ec227-bb74-4b13-9f5a-095968298bd9 req-9a2352dc-c5cb-42eb-975f-23af03fdb0d0 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 924.384314] env[65443]: INFO networking_nsxv3.common.synchronization [req-e01ec227-bb74-4b13-9f5a-095968298bd9 req-9a2352dc-c5cb-42eb-975f-23af03fdb0d0 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 924.385028] env[65443]: INFO networking_nsxv3.common.synchronization [req-e01ec227-bb74-4b13-9f5a-095968298bd9 req-9a2352dc-c5cb-42eb-975f-23af03fdb0d0 service nova] Enqueued Resource ID: eb9ecba6-b39f-435b-8456-5e77aa5b3e43 with Priority: HIGHEST for action port [ 924.385133] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 924.385274] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 924.385371] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb9ecba6-b39f-435b-8456-5e77aa5b3e43 with Priority: HIGHEST for action port [ 924.385643] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.385760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.385830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.386037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.386244] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.387360] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.387465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.387663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.387786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.387845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.387987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.388071] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb9ecba6-b39f-435b-8456-5e77aa5b3e43',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.851067] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.851067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.851067] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.851067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.851067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.851837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.852015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.852121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.852220] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.890114] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.890582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.890582] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb9ecba6-b39f-435b-8456-5e77aa5b3e43 with status ACTIVE [ 924.890772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.891965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.891965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.891965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.891965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.891965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.891965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.892232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.892740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.892740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.895167] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.895167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.895385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.895433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.895492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.895586] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb9ecba6-b39f-435b-8456-5e77aa5b3e43 is going to be updated. [ 924.921432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.921432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.921657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.921754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.921906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.922092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb9ecba6-b39f-435b-8456-5e77aa5b3e43" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.932606] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 924.932780] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 924.932895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.933070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.933292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.933530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.933694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.933694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.933879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.933995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.934127] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.354844] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.355690] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.437026] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.758365] env[65443]: INFO networking_nsxv3.common.synchronization [req-a213f6e1-1de4-4b76-803f-f0bbdbb3d56c req-0859595e-fd45-4949-b98f-6814f78e836c tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 925.758599] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 925.759397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.759397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.759397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.759397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.759712] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.759786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.759786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.760216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.760481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.760481] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.858180] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35e12398-e283-4ddb-933f-e2c8972e9c13: rpc.has_security_group_logging(os_id): False [ 925.859167] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.881148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.881148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.881148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.881148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.909259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.909259] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.909259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.909259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.909259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.909259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.909259] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 925.940771] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.999106] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.999106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.999106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.999106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.999106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.015814] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 926.219324] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 926.219530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.263617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.263617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.263889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.263889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.264419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.264419] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.264419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.264713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.264713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.264837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.265559] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 926.304824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.304824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.304824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.304824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.304824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.315886] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 926.366126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.366126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.366126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.366126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.366126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.366126] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 926.412634] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.412836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.412906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.413142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.413290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.424032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 926.443027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.443146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.443146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.444710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.444710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.444710] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 926.479063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.479258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.479309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.479539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.479703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.490252] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 926.715233] env[65443]: INFO networking_nsxv3.common.synchronization [req-5565209d-50df-49dc-a7eb-9638e623e94e req-7e01fecf-539e-46cf-9e4e-0a4e06eaa6ee tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 926.715295] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 926.715621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8291c8a2-5196-4909-b717-eccea89c1ccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.715747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.715841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.716163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.716294] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8291c8a2-5196-4909-b717-eccea89c1ccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.199366] env[65443]: INFO networking_nsxv3.common.synchronization [req-83a6641d-beb9-47fc-a153-28d5b262424f req-6a75065f-5acc-49cf-a0a2-19dc9d4a54e6 tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 927.200180] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 927.200362] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8291c8a2-5196-4909-b717-eccea89c1ccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.200419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.239487] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.239690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.239795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.240050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.240146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.240233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8291c8a2-5196-4909-b717-eccea89c1ccf already deleted. [ 927.240320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.240504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.240695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.240793] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8291c8a2-5196-4909-b717-eccea89c1ccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.384348] env[65443]: INFO networking_nsxv3.common.synchronization [req-02fbd3c4-5e60-4f26-8f71-d13fe8604ed6 req-79a8b87e-4702-4a20-851a-780e0d3c5faf tempest-ImagesOneServerNegativeTestJSON-410701669 tempest-ImagesOneServerNegativeTestJSON-410701669-project-member] Enqueued Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 927.385341] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1004a68b-2190-4689-9601-8db71d48978e with Priority: HIGHEST for action security_group_members [ 927.385341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1004a68b-2190-4689-9601-8db71d48978e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.385474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.385510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.385681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.385883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.385958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.385990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.386606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.386606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.386606] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1004a68b-2190-4689-9601-8db71d48978e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.767928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.769062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.769062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.769062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.769062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.769062] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8291c8a2-5196-4909-b717-eccea89c1ccf already deleted. [ 927.769062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.889726] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.890018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.890018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.890268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.890372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.890584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.890688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.890752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.890915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.890993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.891093] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e is going to be updated. [ 927.927592] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.927849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.928038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.928353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.928628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.942933] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: IN_PROGRESS for 2s [ 928.037471] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 928.037689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.037875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.038223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.038324] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.327595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 928.327807] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 deletion is rescheduled due to dependency. [ 928.327807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.377115] env[65443]: INFO networking_nsxv3.common.synchronization [req-ac982a47-0556-45b1-b659-d8381e6d27bf req-9e6b5073-9c72-4471-91bd-7d6733d181e1 tempest-AttachInterfacesUnderV243Test-680017589 tempest-AttachInterfacesUnderV243Test-680017589-project-member] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 928.377712] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGHEST for action security_group_members [ 928.378715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.378868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.435925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 928.436633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.436633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.436633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.436778] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.436878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.436925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.437513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.437513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.437513] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.502345] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 928.502345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.502345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.502345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.502345] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.502624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.502624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.502681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.502769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.502889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.502995] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.544234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.544465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.872832] env[65443]: INFO networking_nsxv3.common.synchronization [req-2d3cc76f-3586-4f86-baf8-800a3540f54f req-ec2a084a-305a-42d5-974e-4d3308292dab tempest-SecurityGroupRulesTestJSON-16011361 tempest-SecurityGroupRulesTestJSON-16011361-project-member] Enqueued Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 928.873391] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8291c8a2-5196-4909-b717-eccea89c1ccf with Priority: HIGHEST for action security_group_rules [ 928.873732] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8291c8a2-5196-4909-b717-eccea89c1ccf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.873849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.873915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.876604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.876700] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8291c8a2-5196-4909-b717-eccea89c1ccf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.939986] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.940172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.940244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.940466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.940563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.940749] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.940843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.940903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.941057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.941133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.941217] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 928.970999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.971216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.971259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.971534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.971646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.981498] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 929.005755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.005755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.005755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.005755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.005755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.006080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.006080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.006226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.006336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.006451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.006675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.006846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.006920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.007100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.007257] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.007356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.007421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.007567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.007651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.007737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.007830] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.289748] env[65443]: INFO networking_nsxv3.common.synchronization [req-0b116dbe-3d5b-4166-87b9-86002c26aa65 req-169eeec4-8509-4c6c-abc4-d7bb3cc4aec7 tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 929.294153] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 929.294748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.294994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.295173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.295937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.295937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.296247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.296247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.297408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.297408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.297408] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.406955] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.407182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.407182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.407398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.407501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.407595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8291c8a2-5196-4909-b717-eccea89c1ccf already deleted. [ 929.407677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8291c8a2-5196-4909-b717-eccea89c1ccf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.512385] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7259b9-1e79-42d6-87f5-2acdaf792fd0: rpc.has_security_group_logging(os_id): False [ 929.535934] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.536177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.536354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.536466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.536560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.536784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.536891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.536942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.538221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.538372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.538580] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.538691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.538793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.538994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.540686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.540903] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.540996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.541088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.541234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.541315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.541408] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 929.617586] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.618123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.618123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.618123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.618650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.635451] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 929.804052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.804052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.804052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.804052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.824857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.825117] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.825236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.825302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.825492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.825923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.825923] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 929.844199] env[65443]: INFO networking_nsxv3.common.synchronization [req-fd49d619-2b0d-4a84-a46d-94cb6c8c9d7a req-dae26a7a-bdab-4078-b116-3249b01a15c3 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 929.844789] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b with Priority: HIGHEST for action security_group_members [ 929.845101] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-38621128-a58c-43d0-ab77-1ae5a5975b7b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.845224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.845304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.846146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.846146] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.846146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.846146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.846146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.846146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.849417] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38621128-a58c-43d0-ab77-1ae5a5975b7b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.852790] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.852911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.852976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.853175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.853294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.862682] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 929.962665] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1004a68b-2190-4689-9601-8db71d48978e in Status: SUCCESS [ 929.963802] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1004a68b-2190-4689-9601-8db71d48978e deletion is rescheduled due to dependency. [ 929.963802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1004a68b-2190-4689-9601-8db71d48978e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.049884] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcfca66f-60f0-402f-94a5-39178cca5ed3 req-0ad1aa30-224d-419e-8c54-e06d8fb48f21 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 930.050821] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 930.051219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.051364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.051441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.051670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.051831] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.052092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.052161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.052347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.052459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.052685] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.350378] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.350618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.350618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.350773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.376442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.376442] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.376590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.376634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.376818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.376900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.376987] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b is going to be updated. [ 930.418190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.418394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.418439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.418703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.418830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.431787] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: IN_PROGRESS for 2s [ 930.513809] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.514128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.514128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.514437] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.514742] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.514965] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.519021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.519021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.519021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.519021] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.519021] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.519323] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.519323] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.519399] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.519502] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.519635] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.545182] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.545182] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.545182] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.545182] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.545395] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-131d4838-48ea-499f-accc-16d7b5a7e60c taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.545565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.546930] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.548597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.548825] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('131d4838-48ea-499f-accc-16d7b5a7e60c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.555465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.555634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.555711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.556327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.556400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.556584] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.556793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.556793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.556936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.557081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.557139] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 930.586819] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.587028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.587028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.587166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.587341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.599355] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 930.992652] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 930.992948] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 deletion is rescheduled due to dependency. [ 930.993162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.993407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.993723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.993965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.994215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.994320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.994529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.994675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.995391] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.051100] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.051459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.051734] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.052196] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.052387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.052576] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 131d4838-48ea-499f-accc-16d7b5a7e60c not found, creating... [ 931.052982] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.053195] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.053396] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.053931] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.054195] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.054467] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.054752] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.055035] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.055674] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.055674] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.055674] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 131d4838-48ea-499f-accc-16d7b5a7e60c is going to be created. [ 931.075551] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.075771] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.076124] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.076192] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.076403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.076629] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.497536] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.497751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.497862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.498160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.498257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.498459] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.498559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.498620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.498773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.498996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.498996] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 931.526142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.526142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.526142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.526559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.526559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.535998] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 931.651991] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 931.652517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.846066] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcfca66f-60f0-402f-94a5-39178cca5ed3 req-417be479-cc7c-487b-938f-f3325932bcda service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 931.846255] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcfca66f-60f0-402f-94a5-39178cca5ed3 req-417be479-cc7c-487b-938f-f3325932bcda service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 931.846391] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcfca66f-60f0-402f-94a5-39178cca5ed3 req-417be479-cc7c-487b-938f-f3325932bcda service nova] Enqueued Resource ID: 131d4838-48ea-499f-accc-16d7b5a7e60c with Priority: HIGHEST for action port [ 931.846898] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 931.847997] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 931.848874] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 131d4838-48ea-499f-accc-16d7b5a7e60c with Priority: HIGHEST for action port [ 931.849181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.849302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.849372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.849573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.849663] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.850504] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.850622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.851046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-131d4838-48ea-499f-accc-16d7b5a7e60c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.851157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.851220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.851381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.851458] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('131d4838-48ea-499f-accc-16d7b5a7e60c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.874127] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 931.874432] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e deletion is rescheduled due to dependency. [ 931.874578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.355806] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.356053] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.356123] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 131d4838-48ea-499f-accc-16d7b5a7e60c with status ACTIVE [ 932.356270] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.356387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.356446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.356983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.356983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.356983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.356983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.357256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.357256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.357332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.357509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.357594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.357636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.357776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.357911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.357959] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 131d4838-48ea-499f-accc-16d7b5a7e60c is going to be updated. [ 932.381398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.381398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.381398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.381398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.381398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.381398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-131d4838-48ea-499f-accc-16d7b5a7e60c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.449246] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b in Status: SUCCESS [ 932.450236] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38621128-a58c-43d0-ab77-1ae5a5975b7b deletion is rescheduled due to dependency. [ 932.451032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38621128-a58c-43d0-ab77-1ae5a5975b7b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.614174] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 932.614444] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 932.615723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.615723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.615723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.615723] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.615962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.615962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.616111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.616159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.616255] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.119422] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.552236] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 933.552236] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 deletion is rescheduled due to dependency. [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.552236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.552236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.552236] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.622822] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.699281] env[65443]: INFO networking_nsxv3.common.synchronization [None req-528fbcfb-5001-47ab-b7a5-1dfe1283427b None None] Enqueued Resource ID: c2c8be57-1a65-4dca-8d58-0b48ac9cd94f with Priority: HIGHEST for action port [ 933.700392] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2c8be57-1a65-4dca-8d58-0b48ac9cd94f with Priority: HIGHEST for action port [ 933.700751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2c8be57-1a65-4dca-8d58-0b48ac9cd94f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.700931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2c8be57-1a65-4dca-8d58-0b48ac9cd94f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.701041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2c8be57-1a65-4dca-8d58-0b48ac9cd94f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.701796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2c8be57-1a65-4dca-8d58-0b48ac9cd94f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.701900] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2c8be57-1a65-4dca-8d58-0b48ac9cd94f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.054460] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.124991] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.125213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.125295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.125668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.125668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.125898] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 934.155904] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.155904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.155904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.155904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.155904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.168916] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 934.205909] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2c8be57-1a65-4dca-8d58-0b48ac9cd94f [ 934.206166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.207362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.207362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.207362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.207362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.207362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2c8be57-1a65-4dca-8d58-0b48ac9cd94f already deleted. [ 934.207362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2c8be57-1a65-4dca-8d58-0b48ac9cd94f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.557492] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35e12398-e283-4ddb-933f-e2c8972e9c13: rpc.has_security_group_logging(os_id): False [ 934.575386] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.575785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.575785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.575785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.575921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.576258] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.576546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.576546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.576680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.576760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.576845] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be updated. [ 934.647110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.647404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.647404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.647533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.647684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.664237] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: IN_PROGRESS for 2s [ 934.864708] env[65443]: INFO networking_nsxv3.common.synchronization [req-dd2530e4-3210-415c-b707-a0c088eb288d req-ae2f2560-8c90-4a60-a2aa-bc93e30de2f7 tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 934.869758] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 with Priority: HIGHEST for action security_group_members [ 934.870464] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-25b7cad8-5307-463b-8d72-d5e21db9d2b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.870584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.871188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.871188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.871188] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.871376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.871512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.871741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.872332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.872332] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25b7cad8-5307-463b-8d72-d5e21db9d2b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.380251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.380251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.380251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.380251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.427566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.428837] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.428837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.428837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.429164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.429164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.429233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 is going to be updated. [ 935.487038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.487203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.487203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.487887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.487887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.503486] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: IN_PROGRESS for 2s [ 935.582578] env[65443]: INFO networking_nsxv3.common.synchronization [None req-63e20144-8622-465b-810f-f4117c47d955 tempest-ServersV294TestFqdnHostnames-1535385712 tempest-ServersV294TestFqdnHostnames-1535385712-project-member] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 935.583957] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 935.584472] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.584566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.584621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.586161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.586161] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.884539] env[65443]: INFO networking_nsxv3.common.synchronization [None req-26bed74a-3a03-4005-8eb5-ee0e84a34baa tempest-ServersV294TestFqdnHostnames-1535385712 tempest-ServersV294TestFqdnHostnames-1535385712-project-member] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 935.888033] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 935.888033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.888033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.109513] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.110187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.110187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.110187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.110187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.110366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 already deleted. [ 936.110366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.110511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.110623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.110870] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.182347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 936.182958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.183167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.183398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.183611] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.183750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.183820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.183983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.184448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.184448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.184448] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.638809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.639018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.639109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.640173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.640173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.640285] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 already deleted. [ 936.640319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.682378] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 in Status: SUCCESS [ 936.682603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.688471] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.688616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.688686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.688893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.689071] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.689186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.689254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.689468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.689569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.689773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.689997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.690147] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.690242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.690291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.690416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.690491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.690604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.690658] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.929819] env[65443]: INFO networking_nsxv3.common.synchronization [None req-792063ec-e2c8-40c1-8f01-1031b66fe25e None None] Enqueued Resource ID: 215c30b1-0ac8-4faa-b46e-56df49110b67 with Priority: HIGHEST for action port [ 936.930430] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 215c30b1-0ac8-4faa-b46e-56df49110b67 with Priority: HIGHEST for action port [ 936.930785] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-215c30b1-0ac8-4faa-b46e-56df49110b67 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.930985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-215c30b1-0ac8-4faa-b46e-56df49110b67" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.933649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-215c30b1-0ac8-4faa-b46e-56df49110b67" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.933649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-215c30b1-0ac8-4faa-b46e-56df49110b67" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.933649] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('215c30b1-0ac8-4faa-b46e-56df49110b67',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.994134] env[65443]: INFO networking_nsxv3.common.synchronization [req-0fbc06ad-396b-49a9-af59-47c64698c1f0 req-f5bcf833-699a-4b16-a882-3312b2de6c93 tempest-ServersAdminTestJSON-1596753585 tempest-ServersAdminTestJSON-1596753585-project-member] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 936.994134] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGHEST for action security_group_members [ 936.994134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.994134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.994134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.994134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.994134] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.994991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.995170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.995517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.995707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.995943] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.193606] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d34e09-75e3-43fa-8d8c-5bb269633d94: rpc.has_security_group_logging(os_id): False [ 937.213465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.215223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.215223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.215223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.219022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.219022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.219022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.219022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.219022] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 937.288136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.288408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.288408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.288488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.289235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.309319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 937.436891] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 215c30b1-0ac8-4faa-b46e-56df49110b67 [ 937.436891] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.436891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.437149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.437227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.437345] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.437436] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:215c30b1-0ac8-4faa-b46e-56df49110b67 already deleted. [ 937.437523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-215c30b1-0ac8-4faa-b46e-56df49110b67" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.444883] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3de242bb-bc0a-4677-822c-68b1dcb30426 None None] Enqueued Resource ID: 76af57fd-c81d-4fb9-975f-252297544249 with Priority: HIGHEST for action port [ 937.445660] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76af57fd-c81d-4fb9-975f-252297544249 with Priority: HIGHEST for action port [ 937.446492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-76af57fd-c81d-4fb9-975f-252297544249 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.447099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76af57fd-c81d-4fb9-975f-252297544249" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.447099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76af57fd-c81d-4fb9-975f-252297544249" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.447099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76af57fd-c81d-4fb9-975f-252297544249" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.447197] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76af57fd-c81d-4fb9-975f-252297544249',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.499017] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.499256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.499331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.499608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.513939] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 in Status: SUCCESS [ 937.514193] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25b7cad8-5307-463b-8d72-d5e21db9d2b3 deletion is rescheduled due to dependency. [ 937.514315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25b7cad8-5307-463b-8d72-d5e21db9d2b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.523400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.523674] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.523787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.523926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.524110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.524238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.524295] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be updated. [ 937.567551] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.567727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.567783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.568196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.568196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.582233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: IN_PROGRESS for 2s [ 937.949600] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76af57fd-c81d-4fb9-975f-252297544249 [ 937.949600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.950038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.950038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.950038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.950124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.950856] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76af57fd-c81d-4fb9-975f-252297544249 already deleted. [ 937.950856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76af57fd-c81d-4fb9-975f-252297544249" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.681094] env[65443]: INFO networking_nsxv3.common.synchronization [None req-d4d684c7-e735-4c41-bee5-4c8f74a12a5f tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 938.681765] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 938.682130] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.682297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.682366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.682592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.682668] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.790030] env[65443]: INFO networking_nsxv3.common.synchronization [None req-179ddd53-f30e-40b3-b8b3-0a9c5dcb4a4f tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 938.790651] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 938.792297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.792432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.203225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.203497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.203497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.203647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.203762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.203891] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 already deleted. [ 939.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.204180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.204698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.204698] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.339041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 939.339365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.594878] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 373eadf5-9140-4fc8-8636-38b8598454fa in Status: SUCCESS [ 939.595119] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa deletion is rescheduled due to dependency. [ 939.599021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.726361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.726598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.726598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.726829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.726920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.727040] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 already deleted. [ 939.727167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.848675] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7c16778e-7c58-4683-85fd-99f480623a07 None None] Enqueued Resource ID: 1c05d8a5-1945-4909-9c9d-cd9cf3482895 with Priority: HIGHEST for action port [ 939.849640] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c05d8a5-1945-4909-9c9d-cd9cf3482895 with Priority: HIGHEST for action port [ 939.850039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c05d8a5-1945-4909-9c9d-cd9cf3482895 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.850279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c05d8a5-1945-4909-9c9d-cd9cf3482895" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.850279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c05d8a5-1945-4909-9c9d-cd9cf3482895" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.850769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c05d8a5-1945-4909-9c9d-cd9cf3482895" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.850769] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c05d8a5-1945-4909-9c9d-cd9cf3482895',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.352682] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1c05d8a5-1945-4909-9c9d-cd9cf3482895 [ 940.352682] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.353166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.353166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.353166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.353166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.353302] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1c05d8a5-1945-4909-9c9d-cd9cf3482895 already deleted. [ 940.353480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c05d8a5-1945-4909-9c9d-cd9cf3482895" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.767604] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4c1a4ac-e73c-490a-9e61-40bdd1b1f845 req-3f04e52f-47fb-496a-aca0-e2c5f915ae3b tempest-ServersNegativeTestMultiTenantJSON-240494906 tempest-ServersNegativeTestMultiTenantJSON-240494906-project-member] Enqueued Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 940.767604] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 940.768801] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.769334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.769548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.769909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.770218] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.770809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.771024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.771358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.771624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.771843] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.177919] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e09d55c-4fca-4bf3-99e5-e9becc7367f3 req-bfe5b5cb-78e2-448b-b565-8ca7b414aa13 tempest-ServerTagsTestJSON-1535616916 tempest-ServerTagsTestJSON-1535616916-project-member] Enqueued Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 941.178502] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ed02cbf-524b-4807-91ae-649fc532249a with Priority: HIGHEST for action security_group_members [ 941.178817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ed02cbf-524b-4807-91ae-649fc532249a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.178943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.179018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.179684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.179854] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.179963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.180042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.180198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.180285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.180418] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ed02cbf-524b-4807-91ae-649fc532249a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.275605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.275793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.275987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.276254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.276358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.276711] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.276852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.276852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.277052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.277181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.277316] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d82110-b86b-41a0-912b-ef943cd62add already deleted. [ 941.277465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.297092] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-722 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.297276] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-722" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.297441] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-722" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.297804] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-722" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.298204] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.298437] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.298701] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.298863] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.299049] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.299299] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.299427] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 941.300038] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 941.300038] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 941.300038] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 941.300038] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 941.300950] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 941.321240] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 941.321240] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 941.321240] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 941.321240] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-722" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.322364] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d9e77ce0-003d-4e65-8a01-162ab6278121 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.322364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.322364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.322364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.322692] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e77ce0-003d-4e65-8a01-162ab6278121',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.682857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.683256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.683256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.683456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.683566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.683808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.683912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.683976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.684163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.684239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.684324] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed02cbf-524b-4807-91ae-649fc532249a is going to be updated. [ 941.722352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.722545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.722545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.723041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.723041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.734387] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: IN_PROGRESS for 2s [ 941.825128] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.825275] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.825395] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.825670] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.825816] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.826227] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d9e77ce0-003d-4e65-8a01-162ab6278121 not found, creating... [ 941.826472] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.827023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.827023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.827134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.827247] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.827529] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.828446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.828446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.828446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.828446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.828704] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d9e77ce0-003d-4e65-8a01-162ab6278121 is going to be created. [ 941.873567] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.873838] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.873935] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.874428] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.874946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.875189] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.624948] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4c1a4ac-e73c-490a-9e61-40bdd1b1f845 req-be4f1db3-dbff-4f4e-808d-419edc895624 service nova] Enqueued Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_rules [ 942.624948] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4c1a4ac-e73c-490a-9e61-40bdd1b1f845 req-be4f1db3-dbff-4f4e-808d-419edc895624 service nova] Enqueued Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 942.624948] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4c1a4ac-e73c-490a-9e61-40bdd1b1f845 req-be4f1db3-dbff-4f4e-808d-419edc895624 service nova] Enqueued Resource ID: d9e77ce0-003d-4e65-8a01-162ab6278121 with Priority: HIGHEST for action port [ 942.626462] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_rules [ 942.626462] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 942.626462] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e77ce0-003d-4e65-8a01-162ab6278121 with Priority: HIGHEST for action port [ 942.626462] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.626876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.626876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.626943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.626976] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.627954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.628054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.628123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.628289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.628471] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.628882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.628977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.629142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.629239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.629313] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.630155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9e77ce0-003d-4e65-8a01-162ab6278121 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.630262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.630318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.630462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.630525] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e77ce0-003d-4e65-8a01-162ab6278121',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.132016] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.133319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9e77ce0-003d-4e65-8a01-162ab6278121 with status ACTIVE [ 943.133728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.133728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.133728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.133915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.133949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.134940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.134940] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.134940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.135384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.136139] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9e77ce0-003d-4e65-8a01-162ab6278121 is going to be updated. [ 943.164579] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.164722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.164790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.164995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.165187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.165300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9e77ce0-003d-4e65-8a01-162ab6278121" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.357134] env[65443]: INFO networking_nsxv3.common.synchronization [req-0f4524d6-4d0f-4d43-85c9-5aa06a202150 req-609aceca-7d9c-41d9-9b8f-46b741502af2 tempest-ServerRescueTestJSON-647095704 tempest-ServerRescueTestJSON-647095704-project-member] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 943.357816] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 943.359582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.359582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.359582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.359582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.359897] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.359897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.359997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.360155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.360247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.360348] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.639752] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.743787] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ed02cbf-524b-4807-91ae-649fc532249a in Status: SUCCESS [ 943.743787] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ed02cbf-524b-4807-91ae-649fc532249a deletion is rescheduled due to dependency. [ 943.743787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ed02cbf-524b-4807-91ae-649fc532249a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.780043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.780231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.780303] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.780918] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.781272] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.781447] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.781597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.781835] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.781983] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.782209] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.782374] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.782544] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.782658] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.782773] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.782879] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.783014] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.802251] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.802480] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.802651] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.802870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.803230] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.803561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.803655] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.804016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.804181] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fccdb37-5b85-4c7b-a0f9-1356678dacd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.865951] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.866145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.866230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.866573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.866573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.866975] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.866975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.866975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.867180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.867229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.867318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 already deleted. [ 943.867399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.145086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.145439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.145439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.145584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.145682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.145801] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d82110-b86b-41a0-912b-ef943cd62add is going to be created. [ 944.172376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.172537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.172593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.172804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.172967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.183084] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: UNINITIALIZED for 2s [ 944.307912] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.307912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.307912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.307912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.307912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.307912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 not found, creating... [ 944.307912] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.308322] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.308322] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.308473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.308612] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.308921] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.309096] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.309211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.309433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.309601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.309771] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 is going to be created. [ 944.333471] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.333765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.333847] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.334165] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.334411] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.334658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.541742] env[65443]: INFO networking_nsxv3.common.synchronization [req-82bfbc84-e999-41da-a642-3199683b9500 req-073a0608-46b9-4a04-bf3f-ffe32ec0a9bb tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 944.542933] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c155a28-d058-4976-8391-4c7cb25222de with Priority: HIGHEST for action security_group_members [ 944.544296] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4c155a28-d058-4976-8391-4c7cb25222de taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.544296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.544296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.544490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.544525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.544818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.544925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.545033] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4c155a28-d058-4976-8391-4c7cb25222de',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.048135] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.049379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.049379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.049379] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c155a28-d058-4976-8391-4c7cb25222de is going to be updated. [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [req-0f4524d6-4d0f-4d43-85c9-5aa06a202150 req-e7875bb1-d18c-41ab-a9c8-afcea00dfa96 service nova] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_rules [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [req-0f4524d6-4d0f-4d43-85c9-5aa06a202150 req-e7875bb1-d18c-41ab-a9c8-afcea00dfa96 service nova] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [req-0f4524d6-4d0f-4d43-85c9-5aa06a202150 req-e7875bb1-d18c-41ab-a9c8-afcea00dfa96 service nova] Enqueued Resource ID: 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 with Priority: HIGHEST for action port [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_rules [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 945.058372] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 with Priority: HIGHEST for action port [ 945.058372] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.058372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.058372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.058372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.058372] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.058736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.059392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.059392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.059392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.059392] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.059392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.059392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.060558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.060558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.060558] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.060558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.060558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.060821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.060821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.060821] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8fccdb37-5b85-4c7b-a0f9-1356678dacd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.081850] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.081850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.081850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.081850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.081850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.094685] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: IN_PROGRESS for 2s [ 945.563138] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.564273] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.564416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.564545] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 with status ACTIVE [ 945.565402] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.565402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.565402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.565402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.565402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.565402] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.565402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.565713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.565713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.565713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.565802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.565995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.565995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.566297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.566406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.566501] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8fccdb37-5b85-4c7b-a0f9-1356678dacd0 is going to be updated. [ 945.593860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.594071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.594109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.594340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.594486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.594686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8fccdb37-5b85-4c7b-a0f9-1356678dacd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.069619] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.193889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: SUCCESS [ 946.194206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.194382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.194598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.194794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.194915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.194982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.195147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.195227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.195312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.195401] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.574138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.574138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.574138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.574138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.574138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.574138] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be created. [ 946.599434] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.599626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.599752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.600106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.600215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.610937] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: UNINITIALIZED for 2s [ 946.700160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.700336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.700411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.700624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.700789] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.700910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.700989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.701157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.701239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.701324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.701471] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.702113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.702113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.702207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.702296] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.702390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.702450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.702581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.702662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.702753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.702830] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.108226] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4c155a28-d058-4976-8391-4c7cb25222de in Status: SUCCESS [ 947.108529] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4c155a28-d058-4976-8391-4c7cb25222de deletion is rescheduled due to dependency. [ 947.108706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4c155a28-d058-4976-8391-4c7cb25222de" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.206998] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d82110-b86b-41a0-912b-ef943cd62add: rpc.has_security_group_logging(os_id): False [ 947.230297] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.230514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.230566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.230772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.230861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.231053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.231244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.231294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.231479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.231592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.231815] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.231912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.231973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.232131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.232204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.232540] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.232540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.232703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.232703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.232763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.232868] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d82110-b86b-41a0-912b-ef943cd62add is going to be created. [ 947.314864] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e1584bb9-5fb8-404c-af9b-ff62e1696cef None None] Enqueued Resource ID: b7cf75d3-833d-40a3-95e6-b916b116f359 with Priority: HIGHEST for action port [ 947.315522] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7cf75d3-833d-40a3-95e6-b916b116f359 with Priority: HIGHEST for action port [ 947.315846] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7cf75d3-833d-40a3-95e6-b916b116f359 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.316207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7cf75d3-833d-40a3-95e6-b916b116f359" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.316207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7cf75d3-833d-40a3-95e6-b916b116f359" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.316357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7cf75d3-833d-40a3-95e6-b916b116f359" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.316443] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cf75d3-833d-40a3-95e6-b916b116f359',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.352166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.352166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.352166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.352166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.352166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.365047] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: IN_PROGRESS for 2s [ 947.819136] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7cf75d3-833d-40a3-95e6-b916b116f359 [ 947.819457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.819630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.819630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.822325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.822325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.822325] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7cf75d3-833d-40a3-95e6-b916b116f359 already deleted. [ 947.822325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7cf75d3-833d-40a3-95e6-b916b116f359" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.621762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 948.621762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.622106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.622291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.622473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.622539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.622706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.622776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.622886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.623013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.795238] env[65443]: INFO networking_nsxv3.common.synchronization [None req-364e389b-6e0d-46d3-9ccb-561180d3cefc tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 948.795799] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 948.796157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.796325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.796361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.796584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.796689] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.895156] env[65443]: INFO networking_nsxv3.common.synchronization [None req-8824c77c-7dde-4fc4-893e-5ddf88e1fd28 tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 948.896970] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 948.898108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.898108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.125882] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.126729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.127994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.128262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.128452] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.128565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.128628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.128781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.128884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.128968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.129274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.129274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.129274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.129447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.129531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.129619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.129678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.129804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.129876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.129954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.130050] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.325458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.325626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.325707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.326020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.326130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.326201] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac already deleted. [ 949.326288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.326464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.326649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.326757] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.356772] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e0052559-f550-45f9-b306-5d1167246fff None None] Enqueued Resource ID: 03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d with Priority: HIGHEST for action port [ 949.358400] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d with Priority: HIGHEST for action port [ 949.358771] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.358899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.358970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.359334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.359855] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.390620] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: SUCCESS [ 949.392209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.633313] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5bfca26-c658-4447-930a-98eaefa1aa11: rpc.has_security_group_logging(os_id): False [ 949.653018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.653108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.653197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.653414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.653509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.653789] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.653915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.653980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.654150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.654230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.654442] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.655251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.655251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.660952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.660952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.661116] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be created. [ 949.727492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.727661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.727709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.727913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.728143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.741350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 949.854482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.854482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.854482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.854482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.854482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.854482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac already deleted. [ 949.854482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.863149] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d [ 949.863449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.863593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.863720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.864025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.864106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.864207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d already deleted. [ 949.864292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03d3f6e4-a11a-4b17-95a3-d8f13ff7da9d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.561744] env[65443]: INFO networking_nsxv3.common.synchronization [None req-757cafb6-ce45-48a9-baf0-cd1983514174 None None] Enqueued Resource ID: 36cc1747-3711-4edf-81ec-574addb6e8b3 with Priority: HIGHEST for action port [ 950.562399] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36cc1747-3711-4edf-81ec-574addb6e8b3 with Priority: HIGHEST for action port [ 950.562732] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-36cc1747-3711-4edf-81ec-574addb6e8b3 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.562852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36cc1747-3711-4edf-81ec-574addb6e8b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.562918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36cc1747-3711-4edf-81ec-574addb6e8b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.563848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36cc1747-3711-4edf-81ec-574addb6e8b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.563931] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36cc1747-3711-4edf-81ec-574addb6e8b3',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.066955] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 36cc1747-3711-4edf-81ec-574addb6e8b3 [ 951.067202] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.067308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.067376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.067623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.067886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.067999] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:36cc1747-3711-4edf-81ec-574addb6e8b3 already deleted. [ 951.068110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36cc1747-3711-4edf-81ec-574addb6e8b3" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.755056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 951.755402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.351155] env[65443]: INFO networking_nsxv3.common.synchronization [None req-2abf5f8c-2209-42a0-95c7-d7dc929ec8aa None None] Enqueued Resource ID: 0a2581bb-dd15-4d00-9474-7a410b3930b4 with Priority: HIGHEST for action port [ 953.354404] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a2581bb-dd15-4d00-9474-7a410b3930b4 with Priority: HIGHEST for action port [ 953.354404] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a2581bb-dd15-4d00-9474-7a410b3930b4 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.354404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a2581bb-dd15-4d00-9474-7a410b3930b4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.354404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a2581bb-dd15-4d00-9474-7a410b3930b4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.354404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a2581bb-dd15-4d00-9474-7a410b3930b4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.354404] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a2581bb-dd15-4d00-9474-7a410b3930b4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.856888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a2581bb-dd15-4d00-9474-7a410b3930b4 [ 953.857043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.857972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.857972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.857972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.857972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.857972] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a2581bb-dd15-4d00-9474-7a410b3930b4 already deleted. [ 953.858219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a2581bb-dd15-4d00-9474-7a410b3930b4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.288150] env[65443]: INFO networking_nsxv3.common.synchronization [None req-77871da3-be55-4e3b-8116-28499d10ddae None None] Enqueued Resource ID: 944719cb-898a-42a6-a648-a3e78f575e35 with Priority: HIGHEST for action port [ 954.291997] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 944719cb-898a-42a6-a648-a3e78f575e35 with Priority: HIGHEST for action port [ 954.293201] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-944719cb-898a-42a6-a648-a3e78f575e35 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.293727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-944719cb-898a-42a6-a648-a3e78f575e35" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.293727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-944719cb-898a-42a6-a648-a3e78f575e35" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.294150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-944719cb-898a-42a6-a648-a3e78f575e35" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.294304] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('944719cb-898a-42a6-a648-a3e78f575e35',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.614392] env[65443]: INFO networking_nsxv3.common.synchronization [req-60f8446b-24aa-452f-8bcb-eaf18803e131 req-24eb027f-e081-4927-b91c-92d42cb61540 tempest-MigrationsAdminTest-1373625124 tempest-MigrationsAdminTest-1373625124-project-member] Enqueued Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 954.614974] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec with Priority: HIGHEST for action security_group_members [ 954.615279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-81bf2cab-4b9a-41ce-82f6-260bedede9ec taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.615397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.615463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.615648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.615794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.615888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.615961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.616203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.616288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.616381] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81bf2cab-4b9a-41ce-82f6-260bedede9ec',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.797940] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 944719cb-898a-42a6-a648-a3e78f575e35 [ 954.800834] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.800834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.800834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.800834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.800834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.800834] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:944719cb-898a-42a6-a648-a3e78f575e35 already deleted. [ 954.800834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-944719cb-898a-42a6-a648-a3e78f575e35" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.118817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.118930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.119210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.119335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.146344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.146344] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.146344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.146344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.146344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.146344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.150021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec is going to be updated. [ 955.179175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.180949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.180949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.180949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.180949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.190783] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: IN_PROGRESS for 2s [ 955.234647] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3afc4023-81f9-4b79-b06c-6e989de2d8a3 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 955.235044] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 955.235356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.235479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.235547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.235814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.235900] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.365621] env[65443]: INFO networking_nsxv3.common.synchronization [None req-63e19636-b9ed-4757-b3d2-2c6842c323de tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 955.366210] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 955.366530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.366618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.691346] env[65443]: INFO networking_nsxv3.common.synchronization [req-8b7d2bf7-5a3e-42c5-ba74-d259c67065e8 req-d42efa1f-1df2-451b-ad3b-cd08c2a326ca tempest-ServersNegativeTestMultiTenantJSON-240494906 tempest-ServersNegativeTestMultiTenantJSON-240494906-project-member] Enqueued Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 955.692583] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d82110-b86b-41a0-912b-ef943cd62add with Priority: HIGHEST for action security_group_members [ 955.692583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d82110-b86b-41a0-912b-ef943cd62add taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.692583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.692583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.694021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.694253] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.694364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.695397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.695397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.695397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.695397] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d82110-b86b-41a0-912b-ef943cd62add',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.758861] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.759058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.759153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.759379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.759468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.759560] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 already deleted. [ 955.759639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.759788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.759936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.760037] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.197515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.197680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.197763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.198027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.198129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.198549] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.198549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.198549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.198740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.198830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.198920] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d82110-b86b-41a0-912b-ef943cd62add is going to be updated. [ 956.226037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.226037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.226037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.226239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.226379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.238157] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: IN_PROGRESS for 2s [ 956.280964] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.281164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.281164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.281599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.281599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.281599] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 already deleted. [ 956.281733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.960486] env[65443]: INFO networking_nsxv3.common.synchronization [None req-7a1e29c4-51cc-450e-8af3-6b6d95175860 None None] Enqueued Resource ID: 8ee3e16c-3dd8-4001-a3ca-a6852437f891 with Priority: HIGHEST for action port [ 956.961841] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ee3e16c-3dd8-4001-a3ca-a6852437f891 with Priority: HIGHEST for action port [ 956.961841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8ee3e16c-3dd8-4001-a3ca-a6852437f891 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.962017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8ee3e16c-3dd8-4001-a3ca-a6852437f891" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.962234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8ee3e16c-3dd8-4001-a3ca-a6852437f891" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.962532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8ee3e16c-3dd8-4001-a3ca-a6852437f891" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.962653] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8ee3e16c-3dd8-4001-a3ca-a6852437f891',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.206872] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec in Status: SUCCESS [ 957.208418] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81bf2cab-4b9a-41ce-82f6-260bedede9ec deletion is rescheduled due to dependency. [ 957.208418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81bf2cab-4b9a-41ce-82f6-260bedede9ec" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.464918] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8ee3e16c-3dd8-4001-a3ca-a6852437f891 [ 957.465128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.465257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.465329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.465531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.465617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.465758] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8ee3e16c-3dd8-4001-a3ca-a6852437f891 already deleted. [ 957.465796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8ee3e16c-3dd8-4001-a3ca-a6852437f891" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.249844] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d82110-b86b-41a0-912b-ef943cd62add in Status: SUCCESS [ 958.249844] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d82110-b86b-41a0-912b-ef943cd62add deletion is rescheduled due to dependency. [ 958.249844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d82110-b86b-41a0-912b-ef943cd62add" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.022207] env[65443]: INFO networking_nsxv3.common.synchronization [None req-780eeabc-54fc-4147-8c25-6a063f6cd542 None None] Enqueued Resource ID: 66a99b33-3f12-4abc-a4b8-98238d615f4c with Priority: HIGHEST for action port [ 961.026380] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66a99b33-3f12-4abc-a4b8-98238d615f4c with Priority: HIGHEST for action port [ 961.027339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-66a99b33-3f12-4abc-a4b8-98238d615f4c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.027438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66a99b33-3f12-4abc-a4b8-98238d615f4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.027438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66a99b33-3f12-4abc-a4b8-98238d615f4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.030764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66a99b33-3f12-4abc-a4b8-98238d615f4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.030764] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66a99b33-3f12-4abc-a4b8-98238d615f4c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.530180] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66a99b33-3f12-4abc-a4b8-98238d615f4c [ 961.530408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.530584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.530677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.530933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.531081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.531220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66a99b33-3f12-4abc-a4b8-98238d615f4c already deleted. [ 961.531355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66a99b33-3f12-4abc-a4b8-98238d615f4c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.686739] env[65443]: INFO networking_nsxv3.common.synchronization [req-36d6d48e-24bc-41c9-af7b-f8f76d8b9b2e req-bef46cc8-60a4-4051-8391-d8fd6aa7a985 tempest-SecurityGroupRulesNegativeTestJSON-1791422326 tempest-SecurityGroupRulesNegativeTestJSON-1791422326-project-member] Enqueued Resource ID: 22761d62-747f-409a-9de3-76d8a80f8975 with Priority: HIGHEST for action security_group_rules [ 961.687216] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22761d62-747f-409a-9de3-76d8a80f8975 with Priority: HIGHEST for action security_group_rules [ 961.687594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22761d62-747f-409a-9de3-76d8a80f8975 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.687776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.687877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.688219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.688326] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22761d62-747f-409a-9de3-76d8a80f8975',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.215186] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.215474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.215474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.215626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.215677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.215760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22761d62-747f-409a-9de3-76d8a80f8975 already deleted. [ 962.215840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.635859] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c04ebf29-7d23-4ec8-9d16-48c68473c017 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 962.636120] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 962.636422] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.636541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.636604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.636867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.636950] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.772090] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0db9bfb9-7f33-4adc-b526-c92285955a66 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 962.772648] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 962.772958] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.773294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.905645] env[65443]: INFO networking_nsxv3.common.synchronization [req-54097395-3464-4be1-bf5c-f5222e247379 req-f08ed1b5-1c3f-40ce-aa4e-71ba1aac3a6e tempest-SecurityGroupRulesNegativeTestJSON-1791422326 tempest-SecurityGroupRulesNegativeTestJSON-1791422326-project-member] Enqueued Resource ID: 22761d62-747f-409a-9de3-76d8a80f8975 with Priority: HIGHEST for action security_group_rules [ 962.906515] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22761d62-747f-409a-9de3-76d8a80f8975 with Priority: HIGHEST for action security_group_rules [ 962.906841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-22761d62-747f-409a-9de3-76d8a80f8975 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.906963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.907097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.907286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.907689] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('22761d62-747f-409a-9de3-76d8a80f8975',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.163377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.163521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.163592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.163840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.163940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.164031] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384aae03-a82d-4592-a983-85af28dc063f already deleted. [ 963.164251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.164347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.164439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.164531] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.433163] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.433577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.433577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.433733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.433733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.433899] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 22761d62-747f-409a-9de3-76d8a80f8975 already deleted. [ 963.433953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-22761d62-747f-409a-9de3-76d8a80f8975" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.707252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.707408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.707481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.707680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.707767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.707860] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384aae03-a82d-4592-a983-85af28dc063f already deleted. [ 963.707948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.891064] env[65443]: INFO networking_nsxv3.common.synchronization [None req-cebc032b-01ab-44c1-9ea1-2118dee4aa1d None None] Enqueued Resource ID: 33e8a159-7861-4b69-9c6b-03d44f8223dc with Priority: HIGHEST for action port [ 963.891429] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33e8a159-7861-4b69-9c6b-03d44f8223dc with Priority: HIGHEST for action port [ 963.891741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-33e8a159-7861-4b69-9c6b-03d44f8223dc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.891892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33e8a159-7861-4b69-9c6b-03d44f8223dc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.891962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33e8a159-7861-4b69-9c6b-03d44f8223dc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.892217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33e8a159-7861-4b69-9c6b-03d44f8223dc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.892326] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33e8a159-7861-4b69-9c6b-03d44f8223dc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.394537] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33e8a159-7861-4b69-9c6b-03d44f8223dc [ 964.394932] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.395417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.395417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.395417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.395417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.395624] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33e8a159-7861-4b69-9c6b-03d44f8223dc already deleted. [ 964.395624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33e8a159-7861-4b69-9c6b-03d44f8223dc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.868356] env[65443]: INFO networking_nsxv3.common.synchronization [None req-1416c254-dfb6-4da5-906c-cebf1aabe2a0 None None] Enqueued Resource ID: ce29224f-ea8a-481b-9df3-b9ab2b74fc6e with Priority: HIGHEST for action port [ 965.869241] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce29224f-ea8a-481b-9df3-b9ab2b74fc6e with Priority: HIGHEST for action port [ 965.869449] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce29224f-ea8a-481b-9df3-b9ab2b74fc6e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.869507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce29224f-ea8a-481b-9df3-b9ab2b74fc6e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.870124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce29224f-ea8a-481b-9df3-b9ab2b74fc6e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.870124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce29224f-ea8a-481b-9df3-b9ab2b74fc6e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.870124] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce29224f-ea8a-481b-9df3-b9ab2b74fc6e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.372993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce29224f-ea8a-481b-9df3-b9ab2b74fc6e [ 966.373314] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.375684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.375684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.375684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.375684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.375684] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce29224f-ea8a-481b-9df3-b9ab2b74fc6e already deleted. [ 966.375684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce29224f-ea8a-481b-9df3-b9ab2b74fc6e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.081844] env[65443]: INFO networking_nsxv3.common.synchronization [None req-04981a2d-6690-4878-8aaf-e38495481165 None None] Enqueued Resource ID: 37c82a33-d9f2-4eaa-8d30-036ef4ddab0f with Priority: HIGHEST for action port [ 968.082417] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c82a33-d9f2-4eaa-8d30-036ef4ddab0f with Priority: HIGHEST for action port [ 968.082807] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-37c82a33-d9f2-4eaa-8d30-036ef4ddab0f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.082927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37c82a33-d9f2-4eaa-8d30-036ef4ddab0f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.082998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37c82a33-d9f2-4eaa-8d30-036ef4ddab0f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.083461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37c82a33-d9f2-4eaa-8d30-036ef4ddab0f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.083461] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37c82a33-d9f2-4eaa-8d30-036ef4ddab0f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.585760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37c82a33-d9f2-4eaa-8d30-036ef4ddab0f [ 968.586168] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.586318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.586393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.586622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.586715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.586811] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37c82a33-d9f2-4eaa-8d30-036ef4ddab0f already deleted. [ 968.586898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37c82a33-d9f2-4eaa-8d30-036ef4ddab0f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.031283] env[65443]: INFO networking_nsxv3.common.synchronization [req-eff2f1bc-cac2-40d5-9896-ebac5a2352b4 req-cbee061a-9409-4409-b9e0-2bc86a5e262c tempest-ServersV294TestFqdnHostnames-1535385712 tempest-ServersV294TestFqdnHostnames-1535385712-project-member] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 972.031814] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 972.032136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.032260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.032326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.032571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.032721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.032839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.032905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.033531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.033531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.033665] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.447583] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-612 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.447797] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-612" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.447900] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-612" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.448723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-612" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.448723] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.448868] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.448937] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.449184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.449372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.449576] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.449646] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.449753] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.449864] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.449974] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 972.450090] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.450219] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.471843] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.472090] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 972.472346] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.472455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-612" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.472818] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-c69492f8-a792-42b3-8bed-3f8d22ae8175 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.473087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.473243] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.473601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.473770] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69492f8-a792-42b3-8bed-3f8d22ae8175',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.537701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.537860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.537936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.538166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.538254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.538435] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.538531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.538590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.538733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.538806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.538889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 already deleted. [ 972.538965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.976988] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.976988] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.976988] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.976988] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.977200] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.977231] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port c69492f8-a792-42b3-8bed-3f8d22ae8175 not found, creating... [ 972.977481] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.977632] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.977742] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.977959] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.978301] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.978393] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.978540] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.978651] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.978846] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.979133] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.979311] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: c69492f8-a792-42b3-8bed-3f8d22ae8175 is going to be created. [ 973.000515] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.001011] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.001011] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.001186] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.001387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.001609] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.730814] env[65443]: INFO networking_nsxv3.common.synchronization [req-eff2f1bc-cac2-40d5-9896-ebac5a2352b4 req-6f1f8681-ba28-4267-94e1-eee3f4a9a23e service nova] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 973.730814] env[65443]: INFO networking_nsxv3.common.synchronization [req-eff2f1bc-cac2-40d5-9896-ebac5a2352b4 req-6f1f8681-ba28-4267-94e1-eee3f4a9a23e service nova] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 973.731119] env[65443]: INFO networking_nsxv3.common.synchronization [req-eff2f1bc-cac2-40d5-9896-ebac5a2352b4 req-6f1f8681-ba28-4267-94e1-eee3f4a9a23e service nova] Enqueued Resource ID: c69492f8-a792-42b3-8bed-3f8d22ae8175 with Priority: HIGHEST for action port [ 973.731795] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_rules [ 973.731795] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 973.731795] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69492f8-a792-42b3-8bed-3f8d22ae8175 with Priority: HIGHEST for action port [ 973.732517] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.732813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.732813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.733475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.733475] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.735040] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.735040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.735040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.735040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.735040] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.737158] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.737158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69492f8-a792-42b3-8bed-3f8d22ae8175 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.737158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.737158] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69492f8-a792-42b3-8bed-3f8d22ae8175',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.241425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.241556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.241749] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.243310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c69492f8-a792-42b3-8bed-3f8d22ae8175 with status ACTIVE [ 974.243522] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.243619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.243683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.243948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.244050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.244219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.244316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.244378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.244589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.244670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.244916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.245066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.245066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.248074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.248133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.248257] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c69492f8-a792-42b3-8bed-3f8d22ae8175 is going to be updated. [ 974.269628] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.269803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.269880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.270194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.270424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.271029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69492f8-a792-42b3-8bed-3f8d22ae8175" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.602109] env[65443]: INFO networking_nsxv3.common.synchronization [req-346ff18c-f2e2-4cad-910d-f8c297df6c86 req-ec7e0618-e284-4c60-a6f1-1847472d9630 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 974.602109] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 974.602109] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.602109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.602109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.602109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.602109] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.602109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.602109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.602556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.602740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.602914] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.750096] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.009912] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.010130] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.010253] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.010506] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.010749] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.010897] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.011351] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.011648] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.011829] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.012154] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.012154] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 975.012256] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 975.012365] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 975.012473] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 975.012575] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 975.012703] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 975.033342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 975.033671] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 975.033902] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 975.034120] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.034544] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-82d39161-e034-41c2-a203-03294312eea2 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.034781] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.034979] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.035417] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.035627] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d39161-e034-41c2-a203-03294312eea2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.105091] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.147778] env[65443]: INFO networking_nsxv3.common.synchronization [None req-1b40cc85-48f6-4605-a066-d4be4c3e8c3c None None] Enqueued Resource ID: 9344eba5-ee2e-4709-a2df-0afd8bcaa3d2 with Priority: HIGHEST for action port [ 975.148434] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9344eba5-ee2e-4709-a2df-0afd8bcaa3d2 with Priority: HIGHEST for action port [ 975.148750] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-9344eba5-ee2e-4709-a2df-0afd8bcaa3d2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.148873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9344eba5-ee2e-4709-a2df-0afd8bcaa3d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.148942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9344eba5-ee2e-4709-a2df-0afd8bcaa3d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.149288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9344eba5-ee2e-4709-a2df-0afd8bcaa3d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.149389] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9344eba5-ee2e-4709-a2df-0afd8bcaa3d2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.252286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.252483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.252483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.252703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.252793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.252890] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 is going to be created. [ 975.280112] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.280494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.280494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.280594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.281035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.297082] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: UNINITIALIZED for 2s [ 975.538258] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.538499] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.538622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.538894] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.539052] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.539203] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 82d39161-e034-41c2-a203-03294312eea2 not found, creating... [ 975.539459] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.539607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.539720] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.539930] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.540076] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.540347] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.540566] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.540617] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.540793] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.540942] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.541093] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 82d39161-e034-41c2-a203-03294312eea2 is going to be created. [ 975.561836] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.562338] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.562338] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.562587] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.562861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.563145] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.606929] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.651583] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9344eba5-ee2e-4709-a2df-0afd8bcaa3d2 [ 975.652741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.652741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.652741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.652947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.653322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.653322] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9344eba5-ee2e-4709-a2df-0afd8bcaa3d2 already deleted. [ 975.653322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9344eba5-ee2e-4709-a2df-0afd8bcaa3d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.826892] env[65443]: INFO networking_nsxv3.common.synchronization [req-269b1b3d-45f1-442f-94f0-2f176fab21eb req-c23dd06f-9fdf-4292-93db-7c3c84a8765a tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 975.828645] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 975.828645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.828645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.828645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.828645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.828645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.828645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.828982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.828982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.828982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.829103] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.111093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.111093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.111093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.111093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.111093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.111093] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 976.140609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.141768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.141836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.142091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.142202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.154595] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 976.304556] env[65443]: INFO networking_nsxv3.common.synchronization [req-346ff18c-f2e2-4cad-910d-f8c297df6c86 req-8fc63e33-5109-4ca2-b5d7-b90757087152 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 976.304755] env[65443]: INFO networking_nsxv3.common.synchronization [req-346ff18c-f2e2-4cad-910d-f8c297df6c86 req-8fc63e33-5109-4ca2-b5d7-b90757087152 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 976.304990] env[65443]: INFO networking_nsxv3.common.synchronization [req-346ff18c-f2e2-4cad-910d-f8c297df6c86 req-8fc63e33-5109-4ca2-b5d7-b90757087152 service nova] Enqueued Resource ID: 82d39161-e034-41c2-a203-03294312eea2 with Priority: HIGHEST for action port [ 976.305596] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 976.305752] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 976.305860] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82d39161-e034-41c2-a203-03294312eea2 with Priority: HIGHEST for action port [ 976.308285] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.308602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.308602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.308817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.308817] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.309793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.309879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.310146] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-82d39161-e034-41c2-a203-03294312eea2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.310323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.310384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.310633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.310633] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82d39161-e034-41c2-a203-03294312eea2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.330830] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.812980] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.813176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.814554] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82d39161-e034-41c2-a203-03294312eea2 with status ACTIVE [ 976.814775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.814929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.815046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.815377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.815422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.815616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.815730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.815799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.816024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.816176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.816389] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.816494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.816555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.816718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.816850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.816975] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82d39161-e034-41c2-a203-03294312eea2 is going to be updated. [ 976.833980] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.845416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.845599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.845740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.845890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.845998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.846223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82d39161-e034-41c2-a203-03294312eea2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.306996] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: SUCCESS [ 977.307506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.307788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.308087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.308565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.308755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.308814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.309025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.309094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.309150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.309247] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.336253] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.336466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.336565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.340026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.340026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.340026] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be updated. [ 977.369195] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.369402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.369402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.369591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.369735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.380027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 977.387609] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0d954e0d-5541-4c64-b295-cbf1a095aa4c None None] Enqueued Resource ID: cc27c910-8bee-489d-9157-0b5c79cd8640 with Priority: HIGHEST for action port [ 977.388179] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc27c910-8bee-489d-9157-0b5c79cd8640 with Priority: HIGHEST for action port [ 977.388907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc27c910-8bee-489d-9157-0b5c79cd8640 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.388907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc27c910-8bee-489d-9157-0b5c79cd8640" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.388907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc27c910-8bee-489d-9157-0b5c79cd8640" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.389123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc27c910-8bee-489d-9157-0b5c79cd8640" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.389179] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc27c910-8bee-489d-9157-0b5c79cd8640',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.812442] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.890931] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc27c910-8bee-489d-9157-0b5c79cd8640 [ 977.891251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.891315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.891443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.891565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.891652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.891743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc27c910-8bee-489d-9157-0b5c79cd8640 already deleted. [ 977.891829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc27c910-8bee-489d-9157-0b5c79cd8640" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.166222] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 978.166999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.166999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.168750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.168750] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.168750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.168750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.168750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.168750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.168750] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.315772] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 45a15c23-6118-42d8-8638-d27460c7afc6: rpc.has_security_group_logging(os_id): False [ 978.348190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.348482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.348568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.348951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.349184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.349612] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.349800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.349953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.350265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.350424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.350610] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 is going to be created. [ 978.445573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.445573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.445573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.445573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.445573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.461261] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: IN_PROGRESS for 2s [ 978.671318] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.175129] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.320008] env[65443]: INFO networking_nsxv3.common.synchronization [req-be662c43-2aab-446f-af6f-65b2738c4e92 req-81f1b8a5-1fe6-4989-beec-c3a85b7c0e16 tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 979.321350] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 979.321350] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.322332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.323120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.323120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.323120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.323120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.323120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.323407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.323407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.323492] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.389080] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 979.389307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.677061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.677061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.677238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.677437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.677514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.677728] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 979.686883] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.687101] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.687229] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.687552] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.687808] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.688013] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.688101] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.688321] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.688468] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.688677] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.688788] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 979.688897] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 979.689014] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 979.689129] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 979.689234] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 979.689363] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 979.709581] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 979.709672] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 979.709759] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 979.709927] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.710279] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-2d51f333-e777-44b1-b392-f80d31bf5212 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.710460] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.710586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.710915] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.711068] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d51f333-e777-44b1-b392-f80d31bf5212',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.714032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.714193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.714309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.714467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.714616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.724433] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 979.825842] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.826543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.826543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.826543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.826725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.826775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.826885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.826951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.827137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.827220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.827369] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 already deleted. [ 979.827428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.213651] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.214036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.214036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.214812] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.215213] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.215379] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 2d51f333-e777-44b1-b392-f80d31bf5212 not found, creating... [ 980.215646] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.215806] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.215922] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.216702] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.216992] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.217298] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.217464] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.217576] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.217788] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.217921] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.218315] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 2d51f333-e777-44b1-b392-f80d31bf5212 is going to be created. [ 980.244385] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.244807] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.245013] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.245404] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.245771] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.246144] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.474888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: SUCCESS [ 980.475176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.962614] env[65443]: INFO networking_nsxv3.common.synchronization [req-be662c43-2aab-446f-af6f-65b2738c4e92 req-84b2f81d-deb5-4bf8-bb09-ba3dbfdae297 service nova] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 980.963424] env[65443]: INFO networking_nsxv3.common.synchronization [req-be662c43-2aab-446f-af6f-65b2738c4e92 req-84b2f81d-deb5-4bf8-bb09-ba3dbfdae297 service nova] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 980.963801] env[65443]: INFO networking_nsxv3.common.synchronization [req-be662c43-2aab-446f-af6f-65b2738c4e92 req-84b2f81d-deb5-4bf8-bb09-ba3dbfdae297 service nova] Enqueued Resource ID: 2d51f333-e777-44b1-b392-f80d31bf5212 with Priority: HIGHEST for action port [ 980.964751] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 980.965048] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 980.965296] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d51f333-e777-44b1-b392-f80d31bf5212 with Priority: HIGHEST for action port [ 980.965859] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.966125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.966305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.967228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.967228] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.968621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.969535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.969535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.970112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.970373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.970541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.970637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.970886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.971044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.971196] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.973803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d51f333-e777-44b1-b392-f80d31bf5212 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.975036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.975036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.975036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.975326] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d51f333-e777-44b1-b392-f80d31bf5212',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.482262] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.483602] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.483701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.489633] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d51f333-e777-44b1-b392-f80d31bf5212 with status ACTIVE [ 981.489633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.489633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.489633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.489633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.489633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.489633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.490148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.490148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.490148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.490148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.490148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.490402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.490402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.490402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.490502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.490576] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d51f333-e777-44b1-b392-f80d31bf5212 is going to be updated. [ 981.512905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.512905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.512905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.512905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.513198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.513198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.737618] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.737618] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.987994] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.239578] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.239695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.239787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.240009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.240206] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.240302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.240371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.240531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.240617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.240702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.240845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.240934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.240987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.241135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.241263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.241348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.241404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.241533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.241605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.241682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.241813] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.488730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.489129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.489129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.489384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.489862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.489862] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be created. [ 982.513107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.513254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.513324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.513521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.513674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.523386] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: UNINITIALIZED for 2s [ 982.746319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 982.768421] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.768596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.768675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.768900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.768995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.770090] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.770090] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.770090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.770495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.770495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.770495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.770495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.770631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.770631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.770695] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 982.863551] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.863551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.863551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.863551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.863551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.882332] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 984.535074] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: SUCCESS [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.535074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.535074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.535074] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.894247] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 984.894490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.037492] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.540215] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0497189d-9410-4586-bc37-f5d3774f6c57: rpc.has_security_group_logging(os_id): False [ 985.566884] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.567059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.570024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.570024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.570024] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be created. [ 985.650731] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.650731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.650731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.650731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.650731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.664226] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: IN_PROGRESS for 2s [ 985.966518] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 985.966518] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 987.677301] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: SUCCESS [ 987.677723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.587589] env[65443]: INFO networking_nsxv3.common.synchronization [req-9dbcd417-c0e8-4567-92d7-2349f5460e27 req-196f7808-e647-4db4-bfd8-b11d082a7a3c tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 988.588175] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 988.588507] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.588787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.588787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.588958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.589108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.589202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.589269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.589405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.589483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.589577] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.944088] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.944400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.944461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.944794] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.945206] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.945453] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.945608] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.945896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.946191] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.946489] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.946664] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.946856] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.947050] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.947239] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.947438] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.947619] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.968327] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.968501] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.968635] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.968848] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.969195] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-88705932-5cb5-4b60-9702-276bf66772eb taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.969400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.969541] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.969879] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.970107] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88705932-5cb5-4b60-9702-276bf66772eb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.092271] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.092423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.092481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.093042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.093042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.093042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.093245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.093245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.093317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.093404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.093450] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 already deleted. [ 989.093532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.472875] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.473129] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.473315] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.473539] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.473994] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.473994] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 88705932-5cb5-4b60-9702-276bf66772eb not found, creating... [ 989.474235] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.474418] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.474540] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.474816] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.474992] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.475362] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.475753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.475753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.475877] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.476048] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.476203] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 88705932-5cb5-4b60-9702-276bf66772eb is going to be created. [ 989.500606] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.500860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.500988] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.501348] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.501601] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.501863] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.206051] env[65443]: INFO networking_nsxv3.common.synchronization [req-9dbcd417-c0e8-4567-92d7-2349f5460e27 req-0fd104a7-4b08-4478-aade-085cdb7c2886 service nova] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_rules [ 990.206455] env[65443]: INFO networking_nsxv3.common.synchronization [req-9dbcd417-c0e8-4567-92d7-2349f5460e27 req-0fd104a7-4b08-4478-aade-085cdb7c2886 service nova] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 990.206455] env[65443]: INFO networking_nsxv3.common.synchronization [req-9dbcd417-c0e8-4567-92d7-2349f5460e27 req-0fd104a7-4b08-4478-aade-085cdb7c2886 service nova] Enqueued Resource ID: 88705932-5cb5-4b60-9702-276bf66772eb with Priority: HIGHEST for action port [ 990.208540] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_rules [ 990.208729] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 990.209236] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88705932-5cb5-4b60-9702-276bf66772eb with Priority: HIGHEST for action port [ 990.209586] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.212825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.213209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.213605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.213726] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.214691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.214824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.214895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.215119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.215291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.215408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.215450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.215592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.215674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.215765] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.216692] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-88705932-5cb5-4b60-9702-276bf66772eb taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.216976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.217061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.217214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.217287] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88705932-5cb5-4b60-9702-276bf66772eb',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.719099] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.719292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.719435] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.720414] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 88705932-5cb5-4b60-9702-276bf66772eb with status ACTIVE [ 990.720639] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.720843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.720843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.721065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.721065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.721487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.721487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.721658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.721658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.721987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.722166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.722468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.722468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.722759] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 88705932-5cb5-4b60-9702-276bf66772eb is going to be updated. [ 990.748332] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.748486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.748557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.748766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.748902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.749072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88705932-5cb5-4b60-9702-276bf66772eb" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.099860] env[65443]: INFO networking_nsxv3.common.synchronization [req-6e450db4-0052-4334-b00b-7226b1376516 req-b8b20c67-3c9a-46d9-be0c-bee3143d04a6 tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 991.100089] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 991.100393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.100537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.100581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.100807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.101086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.104055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.104205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.104441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.104496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.104909] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.225018] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.488211] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.488449] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.488684] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.489041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.491311] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.492128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.492317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.492664] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.492881] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.493489] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.493489] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.493489] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.493489] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.493712] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.493712] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.493858] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.514282] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.514507] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.515950] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.515950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.515950] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-41c5925e-6090-41da-8f95-9a225fa0cd4f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.515950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.515950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.515950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.515950] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41c5925e-6090-41da-8f95-9a225fa0cd4f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.606802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.606965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.607054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.607273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.607392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.607594] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.607707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.607707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.607838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.607888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.607973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac already deleted. [ 991.608062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.729232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.729450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.729514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.729723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.729842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.729944] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be created. [ 991.753365] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.753517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.753566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.753773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.753931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.762966] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: UNINITIALIZED for 2s [ 992.020403] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.020776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.020928] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.021237] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.021719] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.021719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 41c5925e-6090-41da-8f95-9a225fa0cd4f not found, creating... [ 992.021944] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.022264] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.022466] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.022746] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.022911] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.023312] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.023541] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.023758] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.024712] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.025223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.025386] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 41c5925e-6090-41da-8f95-9a225fa0cd4f is going to be created. [ 992.046241] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.046503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.046554] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.046825] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.047064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.047288] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.780497] env[65443]: INFO networking_nsxv3.common.synchronization [req-6e450db4-0052-4334-b00b-7226b1376516 req-a8f71147-4c1e-4a60-b494-60cc4b992216 service nova] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 992.780771] env[65443]: INFO networking_nsxv3.common.synchronization [req-6e450db4-0052-4334-b00b-7226b1376516 req-a8f71147-4c1e-4a60-b494-60cc4b992216 service nova] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 992.780840] env[65443]: INFO networking_nsxv3.common.synchronization [req-6e450db4-0052-4334-b00b-7226b1376516 req-a8f71147-4c1e-4a60-b494-60cc4b992216 service nova] Enqueued Resource ID: 41c5925e-6090-41da-8f95-9a225fa0cd4f with Priority: HIGHEST for action port [ 992.781556] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_rules [ 992.781653] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 992.781778] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c5925e-6090-41da-8f95-9a225fa0cd4f with Priority: HIGHEST for action port [ 992.782460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.782638] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.782748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.783113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.783252] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.784699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.784912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.785115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.785357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.785557] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.785722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.785820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.786019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.786165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.786298] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.787381] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-41c5925e-6090-41da-8f95-9a225fa0cd4f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.787931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.788012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.788304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.788466] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41c5925e-6090-41da-8f95-9a225fa0cd4f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.291555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.291777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.291907] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.294036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41c5925e-6090-41da-8f95-9a225fa0cd4f with status ACTIVE [ 993.294250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.294372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.294440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.294644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.294732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.294906] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.295019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.295174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.295290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.295290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.295467] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.295560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.295686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.295743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.295844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.295844] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41c5925e-6090-41da-8f95-9a225fa0cd4f is going to be updated. [ 993.321756] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.322015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.322015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.322223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.322394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.322505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41c5925e-6090-41da-8f95-9a225fa0cd4f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.594834] env[65443]: INFO networking_nsxv3.common.synchronization [req-5df6878a-823d-4dc4-9dd8-dcd4a5b4bc9c req-ef22eb04-8eb5-43b0-ad97-4f22c8986a39 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 993.595464] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 993.595856] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.595955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.595955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.599588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.599588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.599588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.599588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.599588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.599588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.599588] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.705919] env[65443]: INFO networking_nsxv3.common.synchronization [req-b208ed19-5431-4e4e-8ca0-2dae919d1927 req-61fe8f70-1af4-4846-9311-cc842ef950ba tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 993.705919] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGHEST for action security_group_members [ 993.708591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.708591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.708591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.708591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.772141] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 993.772665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.772665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.772854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.772916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.773019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.773083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.773252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.773336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.773437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.773567] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.797378] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.102171] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.211607] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.211607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.211607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.211607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.235129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.235129] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.235129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.235129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.235129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.235129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.235129] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7ca5770-a687-4792-9de6-c002c902a32a is going to be updated. [ 994.265410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.265603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.265603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.265810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.265997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.275791] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: IN_PROGRESS for 2s [ 994.276136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.276268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.276336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.276537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.276681] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.276780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.276822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.276973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.277067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.277134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.277272] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.277359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.277419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.277555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.277684] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.277777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.277854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.278015] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.278320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.278578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.278800] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.299616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.300815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.300815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.300815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.300815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.300815] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac is going to be created. [ 994.334965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.335285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.335922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.335922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.335922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.350376] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: UNINITIALIZED for 2s [ 994.398412] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.398590] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.398633] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.399219] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.399219] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.399443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.399443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.399765] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.399852] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.400011] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.400118] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.400223] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.400326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.400432] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.400530] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.400660] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.420314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.420504] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.420646] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.420826] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.421210] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-1abd8d35-c490-49a2-beb6-b3d616634c36 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.421400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.421520] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.421874] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.422077] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abd8d35-c490-49a2-beb6-b3d616634c36',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.604602] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.780766] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c23fcc-9053-4dec-a147-96680fce42a2: rpc.has_security_group_logging(os_id): False [ 994.803420] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.803792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.803792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.803926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.804084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.804319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.804419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.804485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.804644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.804752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.804936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.804992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.805093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.805242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.805318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.805524] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.805632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.805694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.805832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.805906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.805991] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be created. [ 994.872432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.872664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.872664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.872771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.872986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.888569] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: IN_PROGRESS for 2s [ 994.925074] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.925310] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.925360] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.925620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.925768] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.925923] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 1abd8d35-c490-49a2-beb6-b3d616634c36 not found, creating... [ 994.926222] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.926387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.926509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.926757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.926897] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.927301] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.927423] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.927467] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.927677] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.927938] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.927938] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 1abd8d35-c490-49a2-beb6-b3d616634c36 is going to be created. [ 994.954707] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.955142] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.955304] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.955681] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.955943] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.956297] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.110028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.110028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.110028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.110028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.110028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.110339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 995.144962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.145236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.145236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.145433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.145581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.162113] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 995.664400] env[65443]: INFO networking_nsxv3.common.synchronization [req-5df6878a-823d-4dc4-9dd8-dcd4a5b4bc9c req-8b250b0a-3c8f-415d-9e9b-0a6bae95efd4 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 995.664992] env[65443]: INFO networking_nsxv3.common.synchronization [req-5df6878a-823d-4dc4-9dd8-dcd4a5b4bc9c req-8b250b0a-3c8f-415d-9e9b-0a6bae95efd4 service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 995.664992] env[65443]: INFO networking_nsxv3.common.synchronization [req-5df6878a-823d-4dc4-9dd8-dcd4a5b4bc9c req-8b250b0a-3c8f-415d-9e9b-0a6bae95efd4 service nova] Enqueued Resource ID: 1abd8d35-c490-49a2-beb6-b3d616634c36 with Priority: HIGHEST for action port [ 995.665567] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 995.665776] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 995.665922] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1abd8d35-c490-49a2-beb6-b3d616634c36 with Priority: HIGHEST for action port [ 995.667036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.668662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.668662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.668662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.668662] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.668914] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.668967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.669545] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1abd8d35-c490-49a2-beb6-b3d616634c36 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.669545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.669545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.670259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.670516] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1abd8d35-c490-49a2-beb6-b3d616634c36',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.172373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.172701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.172751] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1abd8d35-c490-49a2-beb6-b3d616634c36 with status ACTIVE [ 996.172879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.172987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.173064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.173268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.173353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.173517] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.173675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.173675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.173842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.173886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.174061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.174145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.174198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.174336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.174410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.174485] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1abd8d35-c490-49a2-beb6-b3d616634c36 is going to be updated. [ 996.198042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.198225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.198270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.198545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.198718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.198926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1abd8d35-c490-49a2-beb6-b3d616634c36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.298155] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7ca5770-a687-4792-9de6-c002c902a32a in Status: SUCCESS [ 996.298393] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7ca5770-a687-4792-9de6-c002c902a32a deletion is rescheduled due to dependency. [ 996.298585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.360550] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: SUCCESS [ 996.360765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.360927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.361154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.361346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.361461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.361862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.361862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.361862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.361862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.362089] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.863949] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.902641] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 996.903803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.169912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 997.170217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.170415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.170607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.170799] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.170914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.170977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.171292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.171292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.171292] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.185940] env[65443]: INFO networking_nsxv3.common.synchronization [req-19c159e7-88b8-4588-bc3d-1669e2690fdf req-3cdfe90e-5dbc-43a2-8e55-de97f2815ea6 tempest-ServerGroupTestJSON-694706050 tempest-ServerGroupTestJSON-694706050-project-member] Enqueued Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 997.186686] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 997.187204] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.187204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.187204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.187470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.187641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.187770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.188080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.188080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.188080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.188238] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.367281] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdd1a1b-593c-44b0-8326-46df0c2407ac: rpc.has_security_group_logging(os_id): False [ 997.389890] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.390247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.390409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.390571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.390744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.390900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.391125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.391125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.391225] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac is going to be created. [ 997.452922] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.453149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.453251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.453503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.453658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.469647] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: IN_PROGRESS for 2s [ 997.572015] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-472 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.572293] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-472" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.572446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-472" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.572990] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-472" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.573246] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.573447] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.573607] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.573893] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.574220] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.574804] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.574804] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 997.574804] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 997.574961] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 997.575036] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 997.576030] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 997.576030] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 997.609119] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 997.609119] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 997.609255] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 997.609389] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-472" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.609711] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-0a6c84a7-2986-4b30-9cca-67c188cfa9be taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.609927] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.610107] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.610445] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.610579] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c84a7-2986-4b30-9cca-67c188cfa9be',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.673974] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.693048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.693048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.693048] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b728a-a884-463f-bb85-b984cae49652 already deleted. [ 997.693048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.114408] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.114642] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.115430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.115430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.115430] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.115605] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 0a6c84a7-2986-4b30-9cca-67c188cfa9be not found, creating... [ 998.115707] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.115870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.116020] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.116323] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.116488] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.119403] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.119403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.119403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.119403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.119403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.119403] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 0a6c84a7-2986-4b30-9cca-67c188cfa9be is going to be created. [ 998.144126] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.144380] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.144505] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.144777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.145529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.145529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.177134] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.680608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.680939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.680939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.681061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.681133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.681233] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 998.717775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.718012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.718135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.718447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.718665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.731054] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 998.866907] env[65443]: INFO networking_nsxv3.common.synchronization [req-19c159e7-88b8-4588-bc3d-1669e2690fdf req-f4e8a945-88c5-4a1e-9a47-65a0747bcc46 service nova] Enqueued Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_rules [ 998.866907] env[65443]: INFO networking_nsxv3.common.synchronization [req-19c159e7-88b8-4588-bc3d-1669e2690fdf req-f4e8a945-88c5-4a1e-9a47-65a0747bcc46 service nova] Enqueued Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 998.866907] env[65443]: INFO networking_nsxv3.common.synchronization [req-19c159e7-88b8-4588-bc3d-1669e2690fdf req-f4e8a945-88c5-4a1e-9a47-65a0747bcc46 service nova] Enqueued Resource ID: 0a6c84a7-2986-4b30-9cca-67c188cfa9be with Priority: HIGHEST for action port [ 998.866907] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_rules [ 998.867499] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 998.867499] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a6c84a7-2986-4b30-9cca-67c188cfa9be with Priority: HIGHEST for action port [ 998.867871] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.868055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.868297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.868637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.868772] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.869791] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.869912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.869980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.870161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.870309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.870407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.870566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.870618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.870679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.870767] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.871765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a6c84a7-2986-4b30-9cca-67c188cfa9be taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.871875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.872016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.872258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.872385] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a6c84a7-2986-4b30-9cca-67c188cfa9be',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.374976] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.379244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.379244] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0a6c84a7-2986-4b30-9cca-67c188cfa9be with status ACTIVE [ 999.379244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.379244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.379244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.379912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.379912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.380157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.380318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.380424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.380641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.380739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.380882] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0a6c84a7-2986-4b30-9cca-67c188cfa9be is going to be updated. [ 999.407072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.407072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.407249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.407302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.407439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.407603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a6c84a7-2986-4b30-9cca-67c188cfa9be" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.486783] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: SUCCESS [ 999.486783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.887231] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.386263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.386458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.386509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.386708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.386798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.386899] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b728a-a884-463f-bb85-b984cae49652 is going to be created. [ 1000.418335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.418522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.418522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.418801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.418801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.431231] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: UNINITIALIZED for 2s [ 1000.741607] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1000.741821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.742064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.742241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.742432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.742546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.742611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.742762] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.742843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.742949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.743068] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.245573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.245855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.245855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.246093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.246286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.246398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.246463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.246625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.246733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.246824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.246992] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.247118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.247172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.247332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.247496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.247606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.247644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.247783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.247880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.247958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.248469] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.752308] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7259b9-1e79-42d6-87f5-2acdaf792fd0: rpc.has_security_group_logging(os_id): False [ 1001.785190] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.785498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.785498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.785719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.785822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.786137] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.786299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.786360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.786562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.786639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.786863] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.787043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.787156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.787342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.787482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.787725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.787862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.787940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.788187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.788320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.788442] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1001.883213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.883439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.883439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.884062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.884062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.908462] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1002.441787] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: SUCCESS [ 1002.442169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.442283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.444107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.444107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.444107] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.949943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.950189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.950270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.950535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.950791] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.950905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.950966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.951155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.951245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.951332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.951487] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.951714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.951802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.951971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.952132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.952227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.952287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.952861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.952993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.953103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.953205] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.457256] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e33b728a-a884-463f-bb85-b984cae49652: rpc.has_security_group_logging(os_id): False [ 1003.478396] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.478396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.478396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.478396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.478607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.478714] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.478865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.478865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.479017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.479087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.479265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.479351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.479469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.479609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.479682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.479859] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.479950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.480016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.480157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.480225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.480325] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b728a-a884-463f-bb85-b984cae49652 is going to be created. [ 1003.551574] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.552115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.552115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.552115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.552335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.570286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: IN_PROGRESS for 2s [ 1003.869210] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1003.869340] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1003.928589] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1003.928854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.323967] env[65443]: INFO networking_nsxv3.common.synchronization [req-37d0d905-015a-4fdb-9d6e-bd991363aaa2 req-0d291045-92e0-4d00-91eb-810a80501755 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1004.324712] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1004.327144] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.328856] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.328856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.328856] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.802860] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.804125] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.804125] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.804125] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.804125] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.804317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.805192] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.805192] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.805192] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.806075] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.806075] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.806075] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.806075] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.806075] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.806075] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.806277] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.829781] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.830189] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.830189] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.830350] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.830604] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.830742] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.830859] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.831292] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.831372] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc0701c8-45d4-467f-a9d7-dd871b9cd5d4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.832867] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.832867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.832867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.833093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.833093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.833163] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.833257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.833318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.833465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.833537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.833631] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 already deleted. [ 1004.833695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.239131] env[65443]: INFO networking_nsxv3.common.synchronization [None req-87625a01-dcdd-4ff6-879b-bf3bce151280 None None] Enqueued Resource ID: 14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1 with Priority: HIGHEST for action port [ 1005.240056] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1 with Priority: HIGHEST for action port [ 1005.240489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.240921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.241200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.241464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.241587] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.335713] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.335981] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.336167] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.336561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.336754] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.336912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 not found, creating... [ 1005.337211] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.337382] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.337513] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.337764] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.337944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.338274] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.338461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.338578] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.338786] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.338918] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.339111] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 is going to be created. [ 1005.361144] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.361440] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.361646] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.362079] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.362322] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.362626] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.583749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: SUCCESS [ 1005.584096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.743414] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1 [ 1005.743850] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.744121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.744427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.745658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.745658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.745658] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1 already deleted. [ 1005.745658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c4c5db-2d1c-4c38-9ff4-6c6de7981bf1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.123969] env[65443]: INFO networking_nsxv3.common.synchronization [req-37d0d905-015a-4fdb-9d6e-bd991363aaa2 req-fea27820-f033-4bfd-90e3-6972ad6edbda service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1006.124313] env[65443]: INFO networking_nsxv3.common.synchronization [req-37d0d905-015a-4fdb-9d6e-bd991363aaa2 req-fea27820-f033-4bfd-90e3-6972ad6edbda service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1006.125444] env[65443]: INFO networking_nsxv3.common.synchronization [req-37d0d905-015a-4fdb-9d6e-bd991363aaa2 req-fea27820-f033-4bfd-90e3-6972ad6edbda service nova] Enqueued Resource ID: fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 with Priority: HIGHEST for action port [ 1006.125444] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1006.125444] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1006.125690] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 with Priority: HIGHEST for action port [ 1006.126666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.126666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.126666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.126666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.126666] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.127149] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.127257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.127316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.127476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.127610] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.127698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.127753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.127889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.127966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.128061] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.129759] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.129759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.129759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.129759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.129759] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc0701c8-45d4-467f-a9d7-dd871b9cd5d4',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.511743] env[65443]: INFO networking_nsxv3.common.synchronization [req-e0725629-4ad3-4c60-964e-db5b4a077489 req-ba82c888-6b4c-456d-b0fc-263bfb9bb96c tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1006.512121] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1006.512443] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.512567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.512628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.512821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.512973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.513086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.513153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.513287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.513369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.513461] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.631672] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.632758] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.632863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.633028] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 with status ACTIVE [ 1006.633192] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.633302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.633389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.634036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.634036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.634036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.634036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.634036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.634299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.634299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.634498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.634644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.634678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.634800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.634873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.634958] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc0701c8-45d4-467f-a9d7-dd871b9cd5d4 is going to be updated. [ 1006.658714] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.658851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.658917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.659152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.660550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.660550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc0701c8-45d4-467f-a9d7-dd871b9cd5d4" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.912938] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.913188] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.913390] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.913579] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.913835] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.913992] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.918539] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.918866] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.919034] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.919268] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.919806] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1006.919806] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1006.919806] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1006.919806] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1006.919806] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1006.920045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1006.940532] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1006.940808] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1006.940954] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1006.941419] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.941842] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-af6f7b74-852c-4d48-970b-470008ad79e9 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.942448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.942448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.942581] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.942950] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af6f7b74-852c-4d48-970b-470008ad79e9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.018611] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.018611] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.018611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.018611] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1007.046284] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.046451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.046717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.046827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.046961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.058156] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1007.139389] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.445914] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.446215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.446659] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.446757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.446896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.447020] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port af6f7b74-852c-4d48-970b-470008ad79e9 not found, creating... [ 1007.447579] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.447579] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.447808] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.447962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.447962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.448349] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.448487] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.448597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.448967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.448967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.450031] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: af6f7b74-852c-4d48-970b-470008ad79e9 is going to be created. [ 1007.476454] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.477226] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.477388] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.478109] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.478109] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.480348] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.609406] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1007.609571] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.644216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.644216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.644216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.644383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.644969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.644969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be created. [ 1007.653378] env[65443]: INFO networking_nsxv3.common.synchronization [None req-78c55754-4009-4ae1-95a2-1dd2dbd4bddf None None] Enqueued Resource ID: bcc54818-fe95-4b43-80c3-1d3cddfac66c with Priority: HIGHEST for action port [ 1007.654339] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcc54818-fe95-4b43-80c3-1d3cddfac66c with Priority: HIGHEST for action port [ 1007.654609] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcc54818-fe95-4b43-80c3-1d3cddfac66c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.654735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcc54818-fe95-4b43-80c3-1d3cddfac66c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.654803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcc54818-fe95-4b43-80c3-1d3cddfac66c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.655480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcc54818-fe95-4b43-80c3-1d3cddfac66c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.655593] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc54818-fe95-4b43-80c3-1d3cddfac66c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.681649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.681886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.681980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.682234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.682681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.702575] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: UNINITIALIZED for 2s [ 1008.160082] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bcc54818-fe95-4b43-80c3-1d3cddfac66c [ 1008.161080] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.161080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.161080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.161080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.161080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.161357] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bcc54818-fe95-4b43-80c3-1d3cddfac66c already deleted. [ 1008.161493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcc54818-fe95-4b43-80c3-1d3cddfac66c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.250738] env[65443]: INFO networking_nsxv3.common.synchronization [req-e0725629-4ad3-4c60-964e-db5b4a077489 req-36cf6910-b6b3-4a31-9373-0311cf4e4773 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1008.250738] env[65443]: INFO networking_nsxv3.common.synchronization [req-e0725629-4ad3-4c60-964e-db5b4a077489 req-36cf6910-b6b3-4a31-9373-0311cf4e4773 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1008.250738] env[65443]: INFO networking_nsxv3.common.synchronization [req-e0725629-4ad3-4c60-964e-db5b4a077489 req-36cf6910-b6b3-4a31-9373-0311cf4e4773 service nova] Enqueued Resource ID: af6f7b74-852c-4d48-970b-470008ad79e9 with Priority: HIGHEST for action port [ 1008.251774] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1008.254047] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1008.254047] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af6f7b74-852c-4d48-970b-470008ad79e9 with Priority: HIGHEST for action port [ 1008.254047] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.254047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.254047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.254047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.254047] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.254797] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.254797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.254797] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-af6f7b74-852c-4d48-970b-470008ad79e9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.254937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.257295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.257295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.257295] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af6f7b74-852c-4d48-970b-470008ad79e9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.700075] env[65443]: INFO networking_nsxv3.common.synchronization [req-a8ca7e03-040f-46e7-9968-d3c44c124e69 req-190e04e2-e898-40fa-8935-72c146d347b2 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1008.701256] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1008.701256] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.701256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.701256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.701519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.702228] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.702228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.702228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.702228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.702228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.702520] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.757546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.757704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.758360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af6f7b74-852c-4d48-970b-470008ad79e9 with status ACTIVE [ 1008.758618] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.758754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.758822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.759064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.759139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.759323] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.759435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.759478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.759636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.759680] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.759854] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.759947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.760019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.760153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.760227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.760310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af6f7b74-852c-4d48-970b-470008ad79e9 is going to be updated. [ 1008.787349] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.787521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.787592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.787803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.787940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.788121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af6f7b74-852c-4d48-970b-470008ad79e9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.069546] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1009.069546] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e deletion is rescheduled due to dependency. [ 1009.069546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.069546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.069851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.069851] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.070101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.070101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.070233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.070293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.070387] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.113851] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.114054] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.114054] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.114617] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.114617] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.114826] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.114950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.115247] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.115397] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.115615] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.115728] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.115837] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.115942] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.116061] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.116165] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.116294] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.139954] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.140181] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.140326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.140529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.140903] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-fbf6fa07-858c-4a26-8c11-8b1471651060 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.141524] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.141524] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.141666] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.141708] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf6fa07-858c-4a26-8c11-8b1471651060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.204669] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.205068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.205181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.205382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.205472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.205962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.206161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.206258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.206437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.206532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.206583] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384aae03-a82d-4592-a983-85af28dc063f already deleted. [ 1009.206651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.573383] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.644403] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.644656] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.644762] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.645117] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.645278] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.645442] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port fbf6fa07-858c-4a26-8c11-8b1471651060 not found, creating... [ 1009.645733] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.646014] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.646225] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.646583] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.646733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.647030] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.647190] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.647309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.647512] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.647644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.647779] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: fbf6fa07-858c-4a26-8c11-8b1471651060 is going to be created. [ 1009.667886] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.668199] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.668374] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.668670] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.668928] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.669171] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.711463] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1009.711870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.712137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.712393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.712704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.712896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.713013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.713235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.713366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.713497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.713700] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.075379] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.216469] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.407879] env[65443]: INFO networking_nsxv3.common.synchronization [req-a8ca7e03-040f-46e7-9968-d3c44c124e69 req-7b1cfb53-22b3-4e97-9781-de1483d9ae1c service nova] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 1010.407879] env[65443]: INFO networking_nsxv3.common.synchronization [req-a8ca7e03-040f-46e7-9968-d3c44c124e69 req-7b1cfb53-22b3-4e97-9781-de1483d9ae1c service nova] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1010.407879] env[65443]: INFO networking_nsxv3.common.synchronization [req-a8ca7e03-040f-46e7-9968-d3c44c124e69 req-7b1cfb53-22b3-4e97-9781-de1483d9ae1c service nova] Enqueued Resource ID: fbf6fa07-858c-4a26-8c11-8b1471651060 with Priority: HIGHEST for action port [ 1010.407879] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_rules [ 1010.408409] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1010.408409] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf6fa07-858c-4a26-8c11-8b1471651060 with Priority: HIGHEST for action port [ 1010.408498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.408665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.408665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.408864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.409088] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.410163] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.410278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.410342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.410605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.410768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.410868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.410932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.411100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.411222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.411276] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.415244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf6fa07-858c-4a26-8c11-8b1471651060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.415360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.415428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.415597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.415678] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf6fa07-858c-4a26-8c11-8b1471651060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.577858] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.578068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.578139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.578349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.578942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.578942] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1010.610328] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.610503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.610562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.610729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.610895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.622683] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1010.719435] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a365df5-ead6-431d-bfd3-bcc282fcd060: rpc.has_security_group_logging(os_id): False [ 1010.746036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.746036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.746036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.746403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.746403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.746621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.746807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.746807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.746948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.747085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.747155] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be created. [ 1010.813233] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.813448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.813569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.813779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.814040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.834830] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1010.919348] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.920694] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.924584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.924840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fbf6fa07-858c-4a26-8c11-8b1471651060 with status ACTIVE [ 1010.925050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.925195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.925251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.925468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.925546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.925750] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.925846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.926307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.926379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.927037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.927037] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.927037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.927037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.927279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.927279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.927347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fbf6fa07-858c-4a26-8c11-8b1471651060 is going to be updated. [ 1010.957509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.957728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.957833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.958274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.958494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.958758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf6fa07-858c-4a26-8c11-8b1471651060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.430258] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.934191] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.934473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.934473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.934736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.934736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.934858] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384aae03-a82d-4592-a983-85af28dc063f is going to be created. [ 1011.967614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.967988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.967988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.968299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.968543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.987050] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: UNINITIALIZED for 2s [ 1012.637386] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1012.637741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.637895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.638301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.638380] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.638520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.638597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.638790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.638961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.639133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.639220] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.850036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1012.850334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.141485] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.645053] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 1013.663952] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.664543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.664543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.664543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.664923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.664923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.665037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.665037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.665160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.665232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.665315] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1013.758089] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.759073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.759073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.759073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.759073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.780741] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1014.000187] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: SUCCESS [ 1014.000433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.000654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.000892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.001529] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.001529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.001529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.001675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.001777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.001911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.002055] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.505703] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.010991] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 384aae03-a82d-4592-a983-85af28dc063f: rpc.has_security_group_logging(os_id): False [ 1015.036045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.036045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.036045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.036045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384aae03-a82d-4592-a983-85af28dc063f is going to be created. [ 1015.117431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.117431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.117431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.117431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.117431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.127637] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: IN_PROGRESS for 2s [ 1015.276187] env[65443]: INFO networking_nsxv3.common.synchronization [req-56ff521b-7155-41f3-b95a-53159461f00e req-6127952f-1c6a-4a15-a714-819f51759b93 tempest-ServerRescueTestJSON-647095704 tempest-ServerRescueTestJSON-647095704-project-member] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1015.276703] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1015.277383] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.277383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.277383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.277652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.277736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.277799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.277854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.278095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.278201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.278314] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.587863] env[65443]: INFO networking_nsxv3.common.synchronization [req-b11d56a2-9029-4786-8325-de7cf2477006 req-901e856a-0e13-434c-a471-9ccf3e42090c tempest-ServerRescueNegativeTestJSON-310292183 tempest-ServerRescueNegativeTestJSON-310292183-project-member] Enqueued Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 1015.588827] env[65443]: INFO networking_nsxv3.common.synchronization [req-aa0b79a7-f9a5-44c7-bacd-c037a031ce22 req-8069c9fc-3366-4df1-b076-54e6e855e53f tempest-ServerGroupTestJSON-694706050 tempest-ServerGroupTestJSON-694706050-project-member] Enqueued Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 1015.590104] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 with Priority: HIGHEST for action security_group_members [ 1015.592606] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGHEST for action security_group_members [ 1015.593183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.593342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.593551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.593790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.593981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.594129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.594246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.594419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.594592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.594746] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32d4eeb4-d8a1-4a19-a639-e9bb163080a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.596157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.596217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.596254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.596918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.596918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.596918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.596918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.597186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.597186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.597266] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.780643] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.797146] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1015.797146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.919025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-385 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.919025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.919025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.919025] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.919501] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.919501] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.919571] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.919693] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.919819] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.919965] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.942972] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.943163] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.943300] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.943473] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-385" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.943786] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.943958] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.944086] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.944434] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.944573] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a5b3991-1a34-4ad2-acfd-fe6103b2d9df',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.099164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.099603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.099603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.099740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.101138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.101259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.121346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.121679] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.121845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.121923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.122192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.122316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.122453] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 is going to be updated. [ 1016.123627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.123830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.123963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.124409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.124543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.124617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.124778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.124874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.124976] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b728a-a884-463f-bb85-b984cae49652 is going to be updated. [ 1016.153160] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.153417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.153417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.153700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.153899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.156262] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.156454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.156557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.156841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.157077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.168380] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: IN_PROGRESS for 2s [ 1016.169063] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: IN_PROGRESS for 2s [ 1016.198428] env[65443]: INFO networking_nsxv3.common.synchronization [req-6bf10488-b5b7-4a7b-aa03-93640fc181fe req-04ee690b-1dcd-416a-8919-b23227c32357 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1016.199263] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1016.200213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.200378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.200650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.200736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.200906] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.201021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.201379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.201592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.201719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.202196] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.284445] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.448127] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.448435] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.448656] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.449032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.449220] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.449379] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df not found, creating... [ 1016.449655] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.449815] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.449929] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.450255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.450410] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.450686] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.450839] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.450955] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.451183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.451313] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.451450] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df is going to be created. [ 1016.473633] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.473800] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.473875] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.474166] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.474834] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.474834] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.704870] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.786959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.787333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.787459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.787867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.788078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.788206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1016.823613] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.825174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.825174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.825174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.825174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.836228] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1017.143087] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: SUCCESS [ 1017.143087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [req-56ff521b-7155-41f3-b95a-53159461f00e req-e16a30bf-55a1-4973-8d0a-82cf4effc634 service nova] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_rules [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [req-56ff521b-7155-41f3-b95a-53159461f00e req-e16a30bf-55a1-4973-8d0a-82cf4effc634 service nova] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [req-56ff521b-7155-41f3-b95a-53159461f00e req-e16a30bf-55a1-4973-8d0a-82cf4effc634 service nova] Enqueued Resource ID: 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df with Priority: HIGHEST for action port [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_rules [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1017.179215] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df with Priority: HIGHEST for action port [ 1017.179530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.179748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.179975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.180275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.180445] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.181531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.181730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.182042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.182306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.184837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.184837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.184837] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a5b3991-1a34-4ad2-acfd-fe6103b2d9df',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.208215] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.686770] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.686920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687169] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df with status ACTIVE [ 1017.687336] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.687443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.687507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.687739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.687836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.689865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.689865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.689865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.689865] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a5b3991-1a34-4ad2-acfd-fe6103b2d9df is going to be updated. [ 1017.710856] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.711108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.711331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.711622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.711773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.711940] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1017.723755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.723755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.723755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.723755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.723755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.725073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a5b3991-1a34-4ad2-acfd-fe6103b2d9df" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.767139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.767294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.767364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.767574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.767784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.780159] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1017.784807] env[65443]: INFO networking_nsxv3.common.synchronization [req-fb5db10c-f929-4ab2-9e7e-91b70b215198 req-5584b7f9-c42b-42c7-a1ad-53e8b73a3d66 tempest-AttachInterfacesV270Test-1102348690 tempest-AttachInterfacesV270Test-1102348690-project-member] Enqueued Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1017.785417] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1017.785706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.785846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.785976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.786268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.786496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.786584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.786747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.786873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.786914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.787043] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.137223] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-10 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.137223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-10" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.137223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-10" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.137223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-10" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.137223] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.140413] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.140692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.141298] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.142334] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.142657] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.143808] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.144271] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.144508] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.144745] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.144957] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.145282] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.167849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.167849] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.167849] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.167849] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-10" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.167849] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d9d84180-16ce-4118-bb55-a3ada13d9b2b taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.167849] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.167849] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.167849] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.167849] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d84180-16ce-4118-bb55-a3ada13d9b2b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.181571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e33b728a-a884-463f-bb85-b984cae49652 in Status: SUCCESS [ 1018.181571] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e33b728a-a884-463f-bb85-b984cae49652 deletion is rescheduled due to dependency. [ 1018.181571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.181571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 in Status: SUCCESS [ 1018.181571] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32d4eeb4-d8a1-4a19-a639-e9bb163080a5 deletion is rescheduled due to dependency. [ 1018.181571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32d4eeb4-d8a1-4a19-a639-e9bb163080a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.291648] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.291648] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.291648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 already deleted. [ 1018.291648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.670324] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.670572] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.670678] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.671051] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.671187] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.671339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d9d84180-16ce-4118-bb55-a3ada13d9b2b not found, creating... [ 1018.671599] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.671762] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.671946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.672180] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.672350] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.672638] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.672795] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.672914] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.673136] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.673268] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.673405] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d9d84180-16ce-4118-bb55-a3ada13d9b2b is going to be created. [ 1018.693206] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.693206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.693206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.693608] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.693608] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.693715] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.848903] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1018.849150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.849323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.849531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.849745] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.851077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.851157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.851326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.851414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.851661] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.356696] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.512810] env[65443]: INFO networking_nsxv3.common.synchronization [req-fb5db10c-f929-4ab2-9e7e-91b70b215198 req-cc3f2888-7138-40cd-9860-0afe37e1dabf service nova] Enqueued Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_rules [ 1019.512963] env[65443]: INFO networking_nsxv3.common.synchronization [req-fb5db10c-f929-4ab2-9e7e-91b70b215198 req-cc3f2888-7138-40cd-9860-0afe37e1dabf service nova] Enqueued Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1019.513138] env[65443]: INFO networking_nsxv3.common.synchronization [req-fb5db10c-f929-4ab2-9e7e-91b70b215198 req-cc3f2888-7138-40cd-9860-0afe37e1dabf service nova] Enqueued Resource ID: d9d84180-16ce-4118-bb55-a3ada13d9b2b with Priority: HIGHEST for action port [ 1019.514260] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_rules [ 1019.514260] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1019.514260] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9d84180-16ce-4118-bb55-a3ada13d9b2b with Priority: HIGHEST for action port [ 1019.514260] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.514460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.514460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.514631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.514744] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.515688] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.515801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.515884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.516112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.516289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.516363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.516363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.516506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.516592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.516707] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.517826] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9d84180-16ce-4118-bb55-a3ada13d9b2b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.517951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.518046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.519013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.519013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9d84180-16ce-4118-bb55-a3ada13d9b2b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.791091] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1019.791287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.859347] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.020432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.020576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.020777] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.025541] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9d84180-16ce-4118-bb55-a3ada13d9b2b with status ACTIVE [ 1020.025784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.025918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.025963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.027403] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.027403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.027893] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.027893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.027893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.027893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.027893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.027893] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9d84180-16ce-4118-bb55-a3ada13d9b2b is going to be updated. [ 1020.049285] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.049433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.049523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.049694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.049822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.049986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9d84180-16ce-4118-bb55-a3ada13d9b2b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.221469] env[65443]: INFO networking_nsxv3.common.synchronization [req-4f2b2386-2756-48ee-83ff-8f3fa3d700a8 req-89e72e97-3ee9-4aee-bb30-a7fc1bbc9421 tempest-ImagesNegativeTestJSON-2018095814 tempest-ImagesNegativeTestJSON-2018095814-project-member] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1020.221542] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1020.221817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.221936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.222012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.222323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.222477] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.222580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.222643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.222790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.222872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.222968] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.362662] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.363055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.363055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.363158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.363263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.363319] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1020.397185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.397376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.397465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.397733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.397937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.409599] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1020.523602] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.587999] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-907 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.588120] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-907" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.588248] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-907" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.588552] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-907" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.588954] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.589303] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.590023] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.590543] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.590733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.590950] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.591079] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.591185] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.591293] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.591402] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.591505] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.591635] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.619638] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.619848] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.619913] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.620119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-907" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.620480] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-3108e29a-769a-4256-8ae7-d829405ae49a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.620659] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.620775] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.621153] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.621296] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3108e29a-769a-4256-8ae7-d829405ae49a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.726728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.726891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.726963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.727486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.727604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.727748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.727852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.727902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.728086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.728165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.728243] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a already deleted. [ 1020.728326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.026643] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.026898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.026970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.027151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.027244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.027349] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 is going to be created. [ 1021.051711] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.051854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.052293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.052293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.052430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.061925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: UNINITIALIZED for 2s [ 1021.127021] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.127021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 3108e29a-769a-4256-8ae7-d829405ae49a not found, creating... [ 1021.127021] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.127021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.127571] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.127571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.127571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.127571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.127571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.127878] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 3108e29a-769a-4256-8ae7-d829405ae49a is going to be created. [ 1021.156042] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.156042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.156042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.156042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.156042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.156042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.870924] env[65443]: INFO networking_nsxv3.common.synchronization [req-4f2b2386-2756-48ee-83ff-8f3fa3d700a8 req-57988d1c-d416-47ce-bc46-04acf82f3dd4 service nova] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_rules [ 1021.870924] env[65443]: INFO networking_nsxv3.common.synchronization [req-4f2b2386-2756-48ee-83ff-8f3fa3d700a8 req-57988d1c-d416-47ce-bc46-04acf82f3dd4 service nova] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1021.871324] env[65443]: INFO networking_nsxv3.common.synchronization [req-4f2b2386-2756-48ee-83ff-8f3fa3d700a8 req-57988d1c-d416-47ce-bc46-04acf82f3dd4 service nova] Enqueued Resource ID: 3108e29a-769a-4256-8ae7-d829405ae49a with Priority: HIGHEST for action port [ 1021.871562] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_rules [ 1021.871693] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1021.871737] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3108e29a-769a-4256-8ae7-d829405ae49a with Priority: HIGHEST for action port [ 1021.872041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.872131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.872206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.872462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.872591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.873439] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.873547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.873694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.875071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.875071] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.875071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.875071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.875071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.875071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.875071] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.875381] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3108e29a-769a-4256-8ae7-d829405ae49a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.875381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.875479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.875654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.875695] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3108e29a-769a-4256-8ae7-d829405ae49a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.379999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.380239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.380532] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.381868] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3108e29a-769a-4256-8ae7-d829405ae49a with status ACTIVE [ 1022.382038] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.382227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.382314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.382579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.382691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.382949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.383068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.383155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.383343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.383436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.383677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.384185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.384185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.384185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.384185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.384366] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3108e29a-769a-4256-8ae7-d829405ae49a is going to be updated. [ 1022.413049] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.413446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.413446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.413446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.413856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.413856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3108e29a-769a-4256-8ae7-d829405ae49a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.424513] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1022.424714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.424814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.425085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.425401] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.425551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.425626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.425828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.425936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.426046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.426169] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.508033] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0339e57b-e6a6-49bb-acfe-ef45e767f3eb tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1022.510167] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1022.510264] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.510424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.510513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.510915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.511074] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.610327] env[65443]: INFO networking_nsxv3.common.synchronization [None req-c332a520-84c7-47f9-bc25-bc7cd1c4ceaf tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1022.611048] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1022.611401] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.611538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.886640] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.929110] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.931254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.931254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.931254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.931254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.932025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.932025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.032744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.032931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.033089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.033185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.034939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.034939] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 already deleted. [ 1023.034939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.034939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.034939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.034939] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.075887] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: SUCCESS [ 1023.076125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.076322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.076574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.076772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.076880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.076951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.077120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.077209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.077275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.077396] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.389925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.390132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.390205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.390560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.390677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.390782] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a is going to be created. [ 1023.416535] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.416734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.416853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.417028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.417216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.434309] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: UNINITIALIZED for 2s [ 1023.434530] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5bfca26-c658-4447-930a-98eaefa1aa11: rpc.has_security_group_logging(os_id): False [ 1023.453707] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.453707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.453944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.453986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.454103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.454379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.454482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.454619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.454793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.454856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.455069] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.455169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.455229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.455416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.455494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.455755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.455848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.455848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.455987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.456075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.456184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1023.518565] env[65443]: INFO networking_nsxv3.common.synchronization [req-43fc2d38-f8b6-4bea-ae5b-99426b479277 req-124a9e2e-db69-4642-b51e-8fcad990d910 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1023.519887] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.520043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.520118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.520329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.520467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.521747] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1023.522412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.522412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.522557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.522684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.522761] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.522853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.522915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.523071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.523162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.523263] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.539883] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1023.558657] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.558876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.558876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.559110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.559216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.559322] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 already deleted. [ 1023.559406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.580009] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.580198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.580273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.580656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.580837] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.580940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.581012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.581180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.581287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.581383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.581531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.581646] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.581743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.581883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.582032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.582123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.582214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.582319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.582393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.582470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.582559] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.025116] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.025575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.025575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.025732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.025732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.025915] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.026030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.026126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.026278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.026384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.026472] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be updated. [ 1024.053589] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.053849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.053849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.053992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.054147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.063264] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: IN_PROGRESS for 2s [ 1024.085443] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 769b4f05-7719-4ada-ab75-56a9d188c7f0: rpc.has_security_group_logging(os_id): False [ 1024.107716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.107936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.107994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.108259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.108351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.108683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.108849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.108932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.109132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.109219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.109454] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.109602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.109674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.109830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.109925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.110150] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.110253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.110604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.110604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.110604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.110829] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 is going to be created. [ 1024.172363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.172586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.172700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.173024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.173316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.188779] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: IN_PROGRESS for 2s [ 1024.723747] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc1dd29-4bc8-4013-9d87-cbcb1569b2e8 req-eef5eb58-28c0-4923-93ef-ee230319e260 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1024.725597] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1024.725958] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.726498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.726498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.726498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.726661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.726796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.726796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.727759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.727759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.727759] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.073704] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.073704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.073704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.073704] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.073704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.074543] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.074888] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.075072] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.075371] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.075507] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.075905] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.075905] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.076050] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.076236] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.076440] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.105254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.105346] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.105480] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.105669] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.106014] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.106216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.106353] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.106704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.106840] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8232a6b8-c41a-4a91-9f1b-65fe7cb58517',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.230605] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.443511] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: SUCCESS [ 1025.443725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.443881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.444104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.444379] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.444540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.444649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.446164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.446164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.446164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.446164] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.570390] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1025.570704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.609778] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.610081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.610222] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.610513] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.610661] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.610819] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 not found, creating... [ 1025.611108] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.611322] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.611462] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.611723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.611867] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.612222] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.612395] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.612510] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.612726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.612860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.613041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 is going to be created. [ 1025.635930] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.636193] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.636359] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.636685] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.636941] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.637379] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.732787] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.947403] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.947624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.947624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.947849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.948009] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.948115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.948178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.948322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.948409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.948495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.948637] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.948729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.948788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.948926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.949070] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.949161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.949220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.949353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.949424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.949500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.949585] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.073874] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 1026.074128] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 deletion is rescheduled due to dependency. [ 1026.074293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.202550] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: SUCCESS [ 1026.202788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.235050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.235302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.235411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.235703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.235909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.235909] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1026.265162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.265295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.265372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.265580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.265722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.278167] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1026.334966] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc1dd29-4bc8-4013-9d87-cbcb1569b2e8 req-f28bbe5a-bb97-4c9a-ab87-93c42104e246 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1026.335727] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc1dd29-4bc8-4013-9d87-cbcb1569b2e8 req-f28bbe5a-bb97-4c9a-ab87-93c42104e246 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1026.335727] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc1dd29-4bc8-4013-9d87-cbcb1569b2e8 req-f28bbe5a-bb97-4c9a-ab87-93c42104e246 service nova] Enqueued Resource ID: 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 with Priority: HIGHEST for action port [ 1026.335969] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1026.336204] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1026.336336] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 with Priority: HIGHEST for action port [ 1026.336636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.336947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.336947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.337124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.337181] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.338410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.338541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.338761] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.338863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.338920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.339219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.339303] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8232a6b8-c41a-4a91-9f1b-65fe7cb58517',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.451402] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd675cf4-d8bc-40d7-9451-8c166df6f58a: rpc.has_security_group_logging(os_id): False [ 1026.471183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.471402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.471601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.471689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.471897] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.471995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.472078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.472316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.472387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.472569] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.472665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.472718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.472856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.472930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.473124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.473219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.473279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.473413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.473485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.473569] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a is going to be created. [ 1026.535214] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.535343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.535464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.535661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.535769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.548286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: IN_PROGRESS for 2s [ 1026.842043] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 with status ACTIVE [ 1026.842201] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.842336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.843310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.843310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.844042] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.844042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.844042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.844042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.844042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.844042] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8232a6b8-c41a-4a91-9f1b-65fe7cb58517 is going to be updated. [ 1026.845166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.845291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.866074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.866231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.866321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.866514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.866652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.866813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8232a6b8-c41a-4a91-9f1b-65fe7cb58517" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.211360] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e2ecd150-4466-4f40-bae6-60dd36cd92d5 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 with Priority: HIGHEST for action security_group_rules [ 1027.211806] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 with Priority: HIGHEST for action security_group_rules [ 1027.211921] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d6e460-0345-4b1f-86a4-188ac6e447a7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.212181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.212335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.212672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.212778] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d6e460-0345-4b1f-86a4-188ac6e447a7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.319757] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4b7bdd9f-8d0c-4de7-9630-23d3b828e3e3 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 with Priority: HIGHEST for action security_group_rules [ 1027.319757] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 with Priority: HIGHEST for action security_group_rules [ 1027.320469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32d6e460-0345-4b1f-86a4-188ac6e447a7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.320594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.739915] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.740150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.740150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.740702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.740702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.740702] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 already deleted. [ 1027.740913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.740913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.741191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.741191] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32d6e460-0345-4b1f-86a4-188ac6e447a7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.264757] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.265185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.265185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.265383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.265499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.265647] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32d6e460-0345-4b1f-86a4-188ac6e447a7 already deleted. [ 1028.265804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32d6e460-0345-4b1f-86a4-188ac6e447a7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.288884] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1028.289205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.289457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.290175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.290955] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.290955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.290955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.290955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.291674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.291674] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.565352] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: SUCCESS [ 1028.565609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.793986] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.296414] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.799469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.799678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.799796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.800084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.800215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.800360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1029.832335] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.832552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.832552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.832681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.832821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.845017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1030.294082] env[65443]: INFO networking_nsxv3.common.synchronization [req-8028df5f-4a75-406a-b9b4-363a70e8a5f7 req-0ebe850e-edd5-477a-a423-7837baffa873 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1030.294707] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1030.295015] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.295143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.295265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.295515] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.295675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.295771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.295834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.295991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.296098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.296206] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.798573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.798973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.798973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.799063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.800064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.800064] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.800064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.800064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.800064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.800064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.800064] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1030.833309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.833531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.833645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.835031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.835031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.844206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1031.552035] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.552035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.552035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.552035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.552035] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.855464] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1031.855787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.855948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.856158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.856356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.856477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.856622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.857367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.857367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.857367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.857367] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.053699] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.360040] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.360231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.360281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.360559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.360862] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.360862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.360964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.361177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.361300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.361461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.361654] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.361788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.361838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.362072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.362217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.362382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.362459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.362631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.362718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.362802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.362895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.556023] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.732217] env[65443]: INFO networking_nsxv3.common.synchronization [req-908e137a-a93f-4a9a-9630-1e672d387106 req-84e40d12-401a-43ef-a50f-45879c33b18b tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1032.732938] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1032.733276] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.733399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.733469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.734890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.735096] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.735216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.735277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.735484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.735575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.735679] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.856218] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1032.856642] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 1032.856693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.865355] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 1032.900827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.900827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.900827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.901736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.901736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.901736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.901736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.901736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.906356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.906356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.906356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1033.006376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.006376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.006510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.006869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.006869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.036017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1033.060556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1033.060556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1033.207754] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.207954] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.208087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.208431] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.208690] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.208851] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.209015] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.209261] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.209416] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.209628] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.209735] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.209841] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.209948] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.210095] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.210200] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.210337] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.231599] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.231814] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.231871] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.232130] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.232522] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-02f068b4-53d0-4dee-af1f-b81afc1c4dab taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.232700] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.232818] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.233177] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.233333] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f068b4-53d0-4dee-af1f-b81afc1c4dab',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.238187] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.238316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.238411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.238635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.238738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.238952] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.239068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.239132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.239294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.239373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.239458] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 already deleted. [ 1033.239540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.736200] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.736470] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.736583] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.736836] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.737013] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.737246] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 02f068b4-53d0-4dee-af1f-b81afc1c4dab not found, creating... [ 1033.737605] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.737811] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.737942] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.738229] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.738407] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.738795] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.739133] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.739269] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.739507] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.739644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.739782] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 02f068b4-53d0-4dee-af1f-b81afc1c4dab is going to be created. [ 1033.761054] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.761305] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.761422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.761754] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.762073] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.762519] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.115519] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.116038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.116038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.116038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.136045] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1034.136593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.137658] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1034.191029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.191029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.191029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.191029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.204785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.205889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1034.206172] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1034.206391] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1034.261024] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.261024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.261024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.261024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.262814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.263293] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1034.366528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.367095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.367317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.367679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.368125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.368580] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1034.452056] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.452282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.452282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.452419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.452692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.452969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:47. [ 1034.453077] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'3e276458-6ae4-4b43-8889-3fac24210880', 'e9c23fcc-9053-4dec-a147-96680fce42a2', '35e12398-e283-4ddb-933f-e2c8972e9c13', '4c429cab-3fa0-42ef-9802-e81f7371a11a', '1bdd1a1b-593c-44b0-8326-46df0c2407ac', 'b1d34e09-75e3-43fa-8d8c-5bb269633d94', 'bf29a740-117d-4608-9ae8-3ea4e2f6be2e', '338befad-e097-41dd-903a-b87985d12b22', 'ca2c637c-a7f1-415d-b0a1-fc76f318aea5', 'd7ca5770-a687-4792-9de6-c002c902a32a', 'cd675cf4-d8bc-40d7-9451-8c166df6f58a', '122d9a8c-f3eb-4ca9-8647-bd1e39de46b9', '8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc', '45a15c23-6118-42d8-8638-d27460c7afc6', '21f2dbdb-92d8-4566-bb7c-8c740d6edde6', 'd885f9be-7315-49b0-bdb6-9777836ebd30', 'e33b728a-a884-463f-bb85-b984cae49652', '4fefe930-a078-492b-8eab-26e076c8e507', '384aae03-a82d-4592-a983-85af28dc063f', 'e5bfca26-c658-4447-930a-98eaefa1aa11', '0497189d-9410-4586-bc37-f5d3774f6c57', '8a21b1b0-a493-4718-8c01-ec2d54222333', 'd41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f', 'ded103e4-c215-45f9-85d6-afc52b8ad0ec', '23540878-f6a1-4e06-86e4-4e60026efbeb', '4c155a28-d058-4976-8391-4c7cb25222de', '256b6662-e079-48f2-8a9b-ddfdeb035f28', '9a365df5-ead6-431d-bfd3-bcc282fcd060', '08bead38-748c-49c3-9386-219294620db2', 'b2d82110-b86b-41a0-912b-ef943cd62add', '3a44c9a5-6f34-40e8-bb18-8fd3522bbccf', '769b4f05-7719-4ada-ab75-56a9d188c7f0', '01bb9589-319b-4790-ae93-ec8c6f99bc54', '81bf2cab-4b9a-41ce-82f6-260bedede9ec', '25b7cad8-5307-463b-8d72-d5e21db9d2b3', '510d8b5d-287f-4b17-a124-e17cca11cba8', 'ca7259b9-1e79-42d6-87f5-2acdaf792fd0', '32d4eeb4-d8a1-4a19-a639-e9bb163080a5', '9b8c4c8d-3b25-4427-a750-99a3dcc5e324', 'f7be5dea-7e21-4d7d-bb55-1264c2bd2864', 'a8408b2f-592c-45ed-bf39-d0ac93e874f2', '1004a68b-2190-4689-9601-8db71d48978e', '0ed02cbf-524b-4807-91ae-649fc532249a', '7c113e23-4653-415c-8339-d252037cc64b', 'eb18cd6e-092e-4f1e-972b-3476700e4c4d', '373eadf5-9140-4fc8-8636-38b8598454fa', '38621128-a58c-43d0-ab77-1ae5a5975b7b'} {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1034.453196] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1034.474248] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.474518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.474518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.474660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.474743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.475058] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1034.475058] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1034.475058] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1034.521529] env[65443]: INFO networking_nsxv3.common.synchronization [req-908e137a-a93f-4a9a-9630-1e672d387106 req-6dba9752-f8fb-4053-802e-2c5a5fd9f528 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1034.521742] env[65443]: INFO networking_nsxv3.common.synchronization [req-908e137a-a93f-4a9a-9630-1e672d387106 req-6dba9752-f8fb-4053-802e-2c5a5fd9f528 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1034.521910] env[65443]: INFO networking_nsxv3.common.synchronization [req-908e137a-a93f-4a9a-9630-1e672d387106 req-6dba9752-f8fb-4053-802e-2c5a5fd9f528 service nova] Enqueued Resource ID: 02f068b4-53d0-4dee-af1f-b81afc1c4dab with Priority: HIGHEST for action port [ 1034.522516] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1034.522708] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1034.522835] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02f068b4-53d0-4dee-af1f-b81afc1c4dab with Priority: HIGHEST for action port [ 1034.523287] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.523415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.523483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.523820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.523930] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.526866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.526975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.527063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.527539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.527728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.527838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.527907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.528073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.528281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.528383] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.529169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-02f068b4-53d0-4dee-af1f-b81afc1c4dab taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.529276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.529636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.529810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.529888] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f068b4-53d0-4dee-af1f-b81afc1c4dab',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.560356] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.560356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.560356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.560356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.560356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.560852] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1034.561091] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1034.561292] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1034.561501] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1034.561705] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/47 resources of Type:Security Group Rules [ 1034.561868] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGH for action security_group_rules [ 1034.563886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.006063] env[65443]: INFO networking_nsxv3.common.synchronization [req-c5f3e4f3-3c88-4051-8495-0823c6fa4450 req-ed3e37d4-8ded-4555-acec-858542d7b061 tempest-ServersV294TestFqdnHostnames-1535385712 tempest-ServersV294TestFqdnHostnames-1535385712-project-member] Enqueued Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 1035.006386] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGHEST for action security_group_members [ 1035.006704] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGH for action security_group_rules [ 1035.006937] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 with Priority: HIGH for action security_group_rules [ 1035.007975] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 1035.008253] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fefe930-a078-492b-8eab-26e076c8e507 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e33b728a-a884-463f-bb85-b984cae49652 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45a15c23-6118-42d8-8638-d27460c7afc6 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d885f9be-7315-49b0-bdb6-9777836ebd30 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7ca5770-a687-4792-9de6-c002c902a32a with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 338befad-e097-41dd-903a-b87985d12b22 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a with Priority: HIGH for action security_group_rules [ 1035.011018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.011018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.011018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.011018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.011018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.011018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.011018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.012114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.012297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.012483] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.013531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.014742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.014940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.015213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.015401] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.016654] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35e12398-e283-4ddb-933f-e2c8972e9c13 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.017625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.017804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.018137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.018328] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35e12398-e283-4ddb-933f-e2c8972e9c13',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.019852] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.020351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.021505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.023019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.023019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.023658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.024075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.030664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fefe930-a078-492b-8eab-26e076c8e507 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.030664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.032560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.032677] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fefe930-a078-492b-8eab-26e076c8e507',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.033700] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e33b728a-a884-463f-bb85-b984cae49652 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.033700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.033700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.033883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.033883] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e33b728a-a884-463f-bb85-b984cae49652',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.034772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-45a15c23-6118-42d8-8638-d27460c7afc6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.037076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.037162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.037737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.037737] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('45a15c23-6118-42d8-8638-d27460c7afc6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.038826] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d885f9be-7315-49b0-bdb6-9777836ebd30 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.038933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.039014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.041090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.041187] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d885f9be-7315-49b0-bdb6-9777836ebd30',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.041988] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.042106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.042172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.042377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.042633] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.044081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.044249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.044341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.044573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.044638] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('122d9a8c-f3eb-4ca9-8647-bd1e39de46b9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.045349] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.045469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.045540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.045884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.046185] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.046860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7ca5770-a687-4792-9de6-c002c902a32a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.046961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.047591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.047591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.047591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7ca5770-a687-4792-9de6-c002c902a32a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.047894] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.047993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.048082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.048461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.048461] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca2c637c-a7f1-415d-b0a1-fc76f318aea5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.049103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.049330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.049391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.049510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.049581] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.050848] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-338befad-e097-41dd-903a-b87985d12b22 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.051148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.051432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.051432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.051529] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('338befad-e097-41dd-903a-b87985d12b22',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.052440] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.052559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.052627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.052784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.052910] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.055813] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.056050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.056050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.056173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.056317] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.057152] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4c429cab-3fa0-42ef-9802-e81f7371a11a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.057256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.057502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.057502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.057502] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4c429cab-3fa0-42ef-9802-e81f7371a11a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.064839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.064983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.065067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.065347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.068199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.068322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.068471] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.069260] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02f068b4-53d0-4dee-af1f-b81afc1c4dab with status ACTIVE [ 1035.069433] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.069545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.069840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.070083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.070180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.070664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.070664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.070664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.070664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.070868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.070907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.070993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.071061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.071324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.071324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.071324] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02f068b4-53d0-4dee-af1f-b81afc1c4dab is going to be updated. [ 1035.106671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.106848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.111225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.111371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.112568] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1035.112791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.115913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.116253] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.116440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.116767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.116846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.117119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.117193] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 is going to be updated. [ 1035.118510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.118733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.125502] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.125690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.125739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.125921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.126079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.126418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02f068b4-53d0-4dee-af1f-b81afc1c4dab" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.128393] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.128523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.207665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.207824] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fefe930-a078-492b-8eab-26e076c8e507 is going to be deleted. [ 1035.208779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.209023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.218767] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.218970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.218970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.219099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.219239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.247064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.247266] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d885f9be-7315-49b0-bdb6-9777836ebd30 is going to be deleted. [ 1035.248138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.248388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.249866] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: IN_PROGRESS for 2s [ 1035.304971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.305138] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be deleted. [ 1035.370194] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.370432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.370432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.370652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.370769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.370889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fefe930-a078-492b-8eab-26e076c8e507" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.393606] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.393850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.393901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.394094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.394187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.394339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d885f9be-7315-49b0-bdb6-9777836ebd30" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.429019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.429302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.429302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.429461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.429523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.429640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.480675] env[65443]: INFO networking_nsxv3.common.synchronization [req-2f2a837f-e858-46cd-93b9-bee155f581f4 req-2591afd4-8421-404e-a3bd-40647738d712 tempest-ImagesNegativeTestJSON-2018095814 tempest-ImagesNegativeTestJSON-2018095814-project-member] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1035.481274] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGHEST for action security_group_members [ 1035.481606] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.481740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.481787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.482319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.482319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.482319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.482319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.482571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.483575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.483575] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.561736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.561924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.561992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.562272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.562482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.562618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.562689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.562857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.562947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.563062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.563158] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.566925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.567063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.567573] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.567730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.567820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.568020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.568183] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.568280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.568336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.568487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.568738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.568838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.570552] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.570552] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.570552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.571072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.571072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.571072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.571943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.572168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.572317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.572432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.572529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.572620] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.577229] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.577399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.577471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.577732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.577828] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.577903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.577963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.578397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.578397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.578397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.579565] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.582621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.582791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.582861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.583181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.583181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.583407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.583407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.583516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.583561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.583613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.584566] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.588459] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.617552] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.617753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.617800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.618048] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.624041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.624167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.644181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.644379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.645250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.645387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.646159] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.646262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.680687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.680871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.681864] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.682016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.683886] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.683986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.684848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.684973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be deleted. [ 1035.686691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.686789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.686880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.687145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.688826] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.688946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.689659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.689775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.709014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.709151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 338befad-e097-41dd-903a-b87985d12b22 is going to be deleted. [ 1035.710131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.710386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.710494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.710620] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 is going to be deleted. [ 1035.711973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.712305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.746637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.746832] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35e12398-e283-4ddb-933f-e2c8972e9c13 is going to be deleted. [ 1035.747997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.748263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.786043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.786208] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be deleted. [ 1035.787173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.787403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.810164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.810316] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc is going to be deleted. [ 1035.812310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.812310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.825961] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.826135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.868653] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.868777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.880301] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.880448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.892164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.892342] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4c429cab-3fa0-42ef-9802-e81f7371a11a is going to be deleted. [ 1035.893216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.893544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.895157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.895342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.922973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.923147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.935874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.936016] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7ca5770-a687-4792-9de6-c002c902a32a is going to be deleted. [ 1035.937050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.937270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.985189] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.985380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.008513] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.008513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.027902] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.027902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.036032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.036032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e33b728a-a884-463f-bb85-b984cae49652 is going to be deleted. [ 1036.037382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.037723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.070416] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.072953] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.076594] env[65443]: INFO networking_nsxv3.common.synchronization [req-786d7f25-5395-413f-aa60-0bd46b9900d5 req-30a6192b-3388-4ed3-8309-418d01894bb3 tempest-AttachInterfacesV270Test-1102348690 tempest-AttachInterfacesV270Test-1102348690-project-member] Enqueued Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1036.077544] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 with Priority: HIGHEST for action security_group_members [ 1036.081636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-769b4f05-7719-4ada-ab75-56a9d188c7f0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.081755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.081798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.082288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.082920] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.083540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.083657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.083929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.084107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.084261] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('769b4f05-7719-4ada-ab75-56a9d188c7f0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.094260] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.098123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.098301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.098496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.098796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.100180] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.100370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.100487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.100766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.100908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.101456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.102117] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.102267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.102518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.102915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.102915] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.103200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.103200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.104873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.104873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.105054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.105230] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.106734] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.110561] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.110561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.110561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.110561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.110561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.110561] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be created. [ 1036.146207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.146554] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca2c637c-a7f1-415d-b0a1-fc76f318aea5 is going to be deleted. [ 1036.147338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.148096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.234394] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.234609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.234720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.234934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.235144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.236993] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.237942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.245090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.245236] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 122d9a8c-f3eb-4ca9-8647-bd1e39de46b9 is going to be deleted. [ 1036.246812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-338befad-e097-41dd-903a-b87985d12b22" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.248560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.248637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.248920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.249082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.249160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35e12398-e283-4ddb-933f-e2c8972e9c13" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.249641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.249641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.249891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.250017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.267779] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: UNINITIALIZED for 2s [ 1036.273236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.273457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.400801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.402508] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.402508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.402508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.402508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.402508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.402508] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a is going to be updated. [ 1036.402797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.403013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.403114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.403241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8eb86cea-a1a0-43a3-9f3d-8b170fc79ccc" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.403422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.403618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.403695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.409031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4c429cab-3fa0-42ef-9802-e81f7371a11a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.409031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.409031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.409031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.409447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7ca5770-a687-4792-9de6-c002c902a32a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.409447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.409447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.409447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.409582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e33b728a-a884-463f-bb85-b984cae49652" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.439016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.439016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.439016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.439016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.439016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.439016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-122d9a8c-f3eb-4ca9-8647-bd1e39de46b9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.439595] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.439595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.439595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.439788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.439788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.439907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca2c637c-a7f1-415d-b0a1-fc76f318aea5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.500065] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1036.500841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.501014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.501111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.501321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.501464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.514872] env[65443]: INFO networking_nsxv3.common.synchronization [req-967aba19-83f8-44a9-af6c-6e9f19b6afa2 req-ba925ee6-a604-49ab-b6dd-5a3f74e2bc62 tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1036.522149] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: IN_PROGRESS for 2s [ 1036.524457] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1036.525490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.525616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.525616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.525814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.526228] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.526228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.526228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.526411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.526411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.526478] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.578317] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 384aae03-a82d-4592-a983-85af28dc063f: rpc.has_security_group_logging(os_id): False [ 1036.580840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 1036.596845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.597061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.597145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.597513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.617999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.618311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.619029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bdd1a1b-593c-44b0-8326-46df0c2407ac: rpc.has_security_group_logging(os_id): False [ 1036.620991] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5bfca26-c658-4447-930a-98eaefa1aa11: rpc.has_security_group_logging(os_id): False [ 1036.623704] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.623888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.624174] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f2dbdb-92d8-4566-bb7c-8c740d6edde6: rpc.has_security_group_logging(os_id): False [ 1036.638022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.638428] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.638537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.638596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.638764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.638898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.639032] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 is going to be updated. [ 1036.640689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.640879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.653240] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.653435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.654970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.654970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.671776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.671910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.683839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.684175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.684370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.684427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.684704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.684793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.684919] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384aae03-a82d-4592-a983-85af28dc063f is going to be updated. [ 1036.686742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.686897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.691291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.691431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.691504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.692148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.692304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.818790] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: IN_PROGRESS for 2s [ 1036.821712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.822250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.822250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.822250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.822580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.822635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.822727] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1036.823814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.824036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.857253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.857574] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.857684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.857733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.857965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.858025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.858097] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac is going to be updated. [ 1036.860135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.860383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.887667] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.887830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.896303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.896858] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.897026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.897103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.897305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.897391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.897604] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.897707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.897788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.897937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.898023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.898217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.898299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.898378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.898560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.898603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.898677] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1036.899791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.899952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.901691] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.901792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.926651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.928842] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.928842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.928842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.928842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.928842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.928842] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1036.928842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.929857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.929857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.930760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.931963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.931963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.949902] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.950087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.950163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.950380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.954063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.965184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: IN_PROGRESS for 2s [ 1036.981956] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1036.987136] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: IN_PROGRESS for 2s [ 1037.015730] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.016605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.016605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.016605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.016605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.028664] env[65443]: INFO networking_nsxv3.common.synchronization [req-2922a7c4-64d9-4aab-bc75-42f1a7ee7108 req-d8d5628f-1756-4408-88d1-c7a4067c01c5 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1037.029164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.029295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.029374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.029618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.031379] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1037.032509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.032901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.033224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.033608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.033854] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.034008] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.034157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.034412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.034568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.034708] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.053570] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1037.088879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.088879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.088879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.088879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.088879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.088879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.088879] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1037.108457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.108457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.108457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.108457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.108457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.153597] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1037.197440] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.197547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.197624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.197849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.198009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.215781] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1037.279880] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 45a15c23-6118-42d8-8638-d27460c7afc6 in Status: SUCCESS [ 1037.280463] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 45a15c23-6118-42d8-8638-d27460c7afc6 deletion is rescheduled due to dependency. [ 1037.281036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-45a15c23-6118-42d8-8638-d27460c7afc6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.537697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.537893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.537893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.538372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.538372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.539094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.539094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.539094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.539094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.539094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.539094] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 already deleted. [ 1037.539094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.598532] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.598730] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.598854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.599157] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.599427] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.599592] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.599711] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.599932] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.600103] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.600368] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.600445] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1037.600552] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1037.600658] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1037.600765] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1037.600869] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1037.600997] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1037.621685] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1037.624135] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1037.624135] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1037.624135] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.624135] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-dba292a4-50d8-437e-a2a9-e9a705632052 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.624135] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.624135] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.624135] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.624135] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba292a4-50d8-437e-a2a9-e9a705632052',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.126474] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.126832] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.127029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.127396] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.127586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.127776] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port dba292a4-50d8-437e-a2a9-e9a705632052 not found, creating... [ 1038.128163] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.128369] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.128526] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.128842] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.129028] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.130037] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.130037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.130037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.130255] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.130298] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.130445] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: dba292a4-50d8-437e-a2a9-e9a705632052 is going to be created. [ 1038.156148] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.156400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.156400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.156739] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.156907] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.158517] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.283114] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1038.284050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.284253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.284917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.284917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.286032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.286032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.286032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.286032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.286032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.286032] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.533173] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: SUCCESS [ 1038.533487] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a deletion is rescheduled due to dependency. [ 1038.533743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.533928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.534382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.534561] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.534751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.534855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.535121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.535220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.535866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.536078] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.768452] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1bd3f90-07b7-49c6-967a-aff7b76244f0 req-cb8a7209-684e-4066-9109-2b889a90fd8f tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1038.769139] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1038.769511] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.769736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.769878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.770136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.770346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.770511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.770614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.770801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.771065] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.771168] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.790128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.790128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.790128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.790406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.790406] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.790636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.790636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.790720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.790920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.791278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.791278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.791472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.791535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.791636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.791789] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.791865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.791914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.792340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.792423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.792912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.792912] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.829730] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 in Status: SUCCESS [ 1038.830018] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 769b4f05-7719-4ada-ab75-56a9d188c7f0 deletion is rescheduled due to dependency. [ 1038.830203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-769b4f05-7719-4ada-ab75-56a9d188c7f0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.917339] env[65443]: INFO networking_nsxv3.common.synchronization [req-2922a7c4-64d9-4aab-bc75-42f1a7ee7108 req-2f9a99b4-393b-4702-9ff9-56e48a0dd2ca service nova] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1038.917404] env[65443]: INFO networking_nsxv3.common.synchronization [req-2922a7c4-64d9-4aab-bc75-42f1a7ee7108 req-2f9a99b4-393b-4702-9ff9-56e48a0dd2ca service nova] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1038.917538] env[65443]: INFO networking_nsxv3.common.synchronization [req-2922a7c4-64d9-4aab-bc75-42f1a7ee7108 req-2f9a99b4-393b-4702-9ff9-56e48a0dd2ca service nova] Enqueued Resource ID: dba292a4-50d8-437e-a2a9-e9a705632052 with Priority: HIGHEST for action port [ 1038.918939] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_rules [ 1038.919131] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1038.919188] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba292a4-50d8-437e-a2a9-e9a705632052 with Priority: HIGHEST for action port [ 1038.919482] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.919696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.919696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.919857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.919930] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.921571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.921719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.921779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.921931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.922092] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.922272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.922709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.922709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.922709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.922709] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.924215] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-dba292a4-50d8-437e-a2a9-e9a705632052 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.924567] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.925865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.925865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.925865] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dba292a4-50d8-437e-a2a9-e9a705632052',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.981276] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: SUCCESS [ 1038.981514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.998911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1038.999140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.002896] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: SUCCESS [ 1039.003120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.038928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.039154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.039154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.039324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.039489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.039587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.039649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.039812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.039903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.040084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.040233] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.040325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.040387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.040526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.040700] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.040751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.040791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.040922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.040996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.041092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.041182] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.052244] env[65443]: INFO networking_nsxv3.common.synchronization [None req-6d41270b-aa5f-4f7a-a35b-dcf8ed1af48e tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1039.052867] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1039.053124] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.053207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.053278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.053533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.053620] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.072547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1039.072679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.168132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1039.168525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.226897] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1039.227245] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 1039.227245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.240919] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.242503] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.242503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.243891] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.243891] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.243891] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1039.243891] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1039.243891] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1039.243891] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1039.243891] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1039.243891] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1039.261344] env[65443]: INFO networking_nsxv3.common.synchronization [None req-724b09d3-2d90-456a-8c78-416dba95cd9a tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1039.263087] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1039.263990] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1039.264163] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1039.264423] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1039.264565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.264867] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-37f80e87-51ca-4703-9b36-188606170213 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.265048] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.265161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.265494] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.265783] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f80e87-51ca-4703-9b36-188606170213',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.267046] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.267131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.273232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.273356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.273429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.273635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.273722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.273901] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.274012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.274076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.274226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.274349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.274411] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be deleted. [ 1039.295379] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1039.318672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.318818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.318887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.319084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.319168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.319376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.319476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.322118] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.322118] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.322118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.322118] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be created. [ 1039.332647] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.332647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.332647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.332647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.332647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.332647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.413588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.413588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.413588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.413588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.413588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.425503] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.432165] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1039.432165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.432165] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dba292a4-50d8-437e-a2a9-e9a705632052 with status ACTIVE [ 1039.432165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.432165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.432165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.433131] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.433131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.433131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.433131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.433131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.433323] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dba292a4-50d8-437e-a2a9-e9a705632052 is going to be updated. [ 1039.463661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.463661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.463661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.463661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.463661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.463661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dba292a4-50d8-437e-a2a9-e9a705632052" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.544780] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd675cf4-d8bc-40d7-9451-8c166df6f58a: rpc.has_security_group_logging(os_id): False [ 1039.585624] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.585624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.585624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.585872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.586052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.586409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.586611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.586724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.587044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.587208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.587565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.587744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.587864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.588137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.588275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.588661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.588848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.588975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.589256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.589401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.589647] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a is going to be updated. [ 1039.592642] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.592884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.593022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.593360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.593483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.593639] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 already deleted. [ 1039.593792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.594886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.595222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.595402] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.683343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.683441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.683519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.683774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.683926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.701144] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: IN_PROGRESS for 2s [ 1039.767749] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.767999] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.768169] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.768560] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.768560] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.768790] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 37f80e87-51ca-4703-9b36-188606170213 not found, creating... [ 1039.768996] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.769367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.769627] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.769964] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.770153] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.770490] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.770700] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.770843] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.771193] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.771395] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.771556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 37f80e87-51ca-4703-9b36-188606170213 is going to be created. [ 1039.825913] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.825913] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.825913] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.825913] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.826278] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.827245] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.932608] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.117365] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.117655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.117655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.117815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.117897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.117997] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 already deleted. [ 1040.118105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.435642] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.435968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.435968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.436078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.436163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.436256] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 is going to be created. [ 1040.467168] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.467321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.467371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.467572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.467727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.479139] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: UNINITIALIZED for 2s [ 1040.595600] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1bd3f90-07b7-49c6-967a-aff7b76244f0 req-b0837ced-9d78-4668-9600-baa76cc147be service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 1040.595859] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1bd3f90-07b7-49c6-967a-aff7b76244f0 req-b0837ced-9d78-4668-9600-baa76cc147be service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1040.596144] env[65443]: INFO networking_nsxv3.common.synchronization [req-a1bd3f90-07b7-49c6-967a-aff7b76244f0 req-b0837ced-9d78-4668-9600-baa76cc147be service nova] Enqueued Resource ID: 37f80e87-51ca-4703-9b36-188606170213 with Priority: HIGHEST for action port [ 1040.596740] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 1040.596890] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1040.596988] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37f80e87-51ca-4703-9b36-188606170213 with Priority: HIGHEST for action port [ 1040.598279] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.598555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.598555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.598774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.598774] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.600121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.600249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.600324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.600510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.600663] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.600758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.600817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.600959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.602837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.602837] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.603282] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-37f80e87-51ca-4703-9b36-188606170213 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.603408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.603690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.603690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.603843] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37f80e87-51ca-4703-9b36-188606170213',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.905356] env[65443]: INFO networking_nsxv3.common.synchronization [req-0daf16c4-139a-4a6d-ad42-a72d58131315 req-7ed76125-693b-46d5-acf8-80007a18c8db tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1040.906254] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1040.906254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.906405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.906405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.906713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.906713] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.906859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.906859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.907106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.907106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.907194] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.105922] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.106118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.106263] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.107211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37f80e87-51ca-4703-9b36-188606170213 with status ACTIVE [ 1041.107450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.108491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.108491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.108491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.108491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.108865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.108865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.108865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.108865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.109160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.112203] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.112379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.112477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.112792] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.113796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.113796] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37f80e87-51ca-4703-9b36-188606170213 is going to be updated. [ 1041.148025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.148025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.148025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.148025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.148025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.148025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37f80e87-51ca-4703-9b36-188606170213" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.409707] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.441358] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1041.441614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.616309] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.715247] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a in Status: SUCCESS [ 1041.715612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.913120] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.119515] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.119675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.119802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.119969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.121042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.121042] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 1042.143668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.143855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.143900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.144236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.144492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.156077] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: UNINITIALIZED for 2s [ 1042.416223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.416223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.416479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.416632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.416754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.416876] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1042.451187] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.451534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.451534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.451710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.452376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.465081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1042.488520] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: SUCCESS [ 1042.488772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.488916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.489160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.489347] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.489468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.489542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.489660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.489742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.489900] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.992017] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.494898] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0885da6-24c4-4fd4-a461-f3dd5063f0a5: rpc.has_security_group_logging(os_id): False [ 1043.514018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.514528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.514688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.514902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.515023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.515321] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.515543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.515622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.515731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.515804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.515899] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 is going to be created. [ 1043.582577] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.582795] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.582883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.584290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.584555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.615727] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: IN_PROGRESS for 2s [ 1044.167153] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1044.167378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.167566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.167896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.168139] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.168258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.168333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.168499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.168610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.168672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.168741] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.474832] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1044.476510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.670937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.670937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.671768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.671768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.671768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.671768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.671768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.671768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.672092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.672092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.672166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.672286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.672349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.672500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.672638] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.673724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.673724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.673724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.673724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.673724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.673724] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.177109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d34e09-75e3-43fa-8d8c-5bb269633d94: rpc.has_security_group_logging(os_id): False [ 1045.199442] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.199612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.199693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.199968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.199968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.200155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.200293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.200349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.200452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.200550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.200773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.200844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.200844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.200982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.201085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.201244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.201335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.201396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.201536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.201607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.201691] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be created. [ 1045.278433] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.278791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.278791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.278995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.279182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.296403] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1045.627738] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: SUCCESS [ 1045.627982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.906641] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1045.906985] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1046.132303] env[65443]: INFO networking_nsxv3.common.synchronization [req-4bd39e6b-520b-4df2-8bc1-f8c53e813e35 req-a1bcaeef-5d83-44c8-92f3-ddc64aef454f tempest-ServerRescueTestJSON-647095704 tempest-ServerRescueTestJSON-647095704-project-member] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1046.132985] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1046.133327] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.133539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.133539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.133743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.134011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.134128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.134195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.134392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.134657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.134757] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.638024] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.029978] env[65443]: INFO networking_nsxv3.common.synchronization [req-29b2f787-ed45-4af2-a860-519af3d0c8aa req-1ad88702-5e01-483c-a810-0fe31a6bb7fb tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1047.030665] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1047.031066] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.032752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.032752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.033263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.033263] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.033419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.033419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.034250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.034250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.034250] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.140659] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.318400] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1047.318756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.536135] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.536366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.536599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.537115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.537230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.537446] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.537552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.537619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.537772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.537843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.537932] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1047.568552] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.569271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.569427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.569759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.569925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.580770] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1047.643433] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.643667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.643667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.643896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.643985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.644108] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1047.674747] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.674981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.675137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.675413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.675638] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.688118] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1049.108748] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4a62593-05b9-499d-a339-dbd94f22ce99 req-c2c82858-5dd5-4871-99f4-6df1cb3c45df tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1049.109311] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1049.109614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.109742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.109810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.110185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.110925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.111275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.111275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.111275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.111383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.111442] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.592981] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1049.593119] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1049.593287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.617348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.617568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.617659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.617849] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.617951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.618023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.618175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.618254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.618343] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1049.661388] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.662950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.662950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.662950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.662950] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.662950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.662950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.663478] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.663817] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.666077] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.666077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.666077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.666077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.666077] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.666077] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.666077] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.666936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.667744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.667863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.668597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.668790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.682141] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1049.696832] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.697030] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.697173] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.697361] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-295" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.697944] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-6ba8ccf9-6afc-41da-bf36-be2aab33f314 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.697944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.698126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.698360] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.698528] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba8ccf9-6afc-41da-bf36-be2aab33f314',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.700643] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1049.700864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.043881] env[65443]: INFO networking_nsxv3.common.synchronization [None req-ee2758f3-2020-42b4-9e1b-c73214b6c974 None None] Enqueued Resource ID: ff655ceb-4543-4059-818a-404345270a3d with Priority: HIGHEST for action port [ 1050.044416] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff655ceb-4543-4059-818a-404345270a3d with Priority: HIGHEST for action port [ 1050.044744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff655ceb-4543-4059-818a-404345270a3d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.044857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff655ceb-4543-4059-818a-404345270a3d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.044931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff655ceb-4543-4059-818a-404345270a3d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.045507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff655ceb-4543-4059-818a-404345270a3d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.045603] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff655ceb-4543-4059-818a-404345270a3d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.202634] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.202944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.202944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.203456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.203456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.203456] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 6ba8ccf9-6afc-41da-bf36-be2aab33f314 not found, creating... [ 1050.203785] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.203949] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.204223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.204348] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.204648] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.204796] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.204905] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.205488] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.205488] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.205488] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 6ba8ccf9-6afc-41da-bf36-be2aab33f314 is going to be created. [ 1050.226777] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.226976] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.227196] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.227478] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.228114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.228459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.548242] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ff655ceb-4543-4059-818a-404345270a3d [ 1050.548472] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.548613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.548682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.548892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.548981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.549081] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ff655ceb-4543-4059-818a-404345270a3d already deleted. [ 1050.549164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff655ceb-4543-4059-818a-404345270a3d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.995122] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4a62593-05b9-499d-a339-dbd94f22ce99 req-01889137-9df8-4526-9332-20669ad488bf service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 1050.995345] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4a62593-05b9-499d-a339-dbd94f22ce99 req-01889137-9df8-4526-9332-20669ad488bf service nova] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1050.995500] env[65443]: INFO networking_nsxv3.common.synchronization [req-d4a62593-05b9-499d-a339-dbd94f22ce99 req-01889137-9df8-4526-9332-20669ad488bf service nova] Enqueued Resource ID: 6ba8ccf9-6afc-41da-bf36-be2aab33f314 with Priority: HIGHEST for action port [ 1050.996459] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_rules [ 1050.996459] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1050.996459] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba8ccf9-6afc-41da-bf36-be2aab33f314 with Priority: HIGHEST for action port [ 1050.996727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.996874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.996956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.997223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.997337] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.998385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.998499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.998762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba8ccf9-6afc-41da-bf36-be2aab33f314 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.998912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.998997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.999226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.999325] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba8ccf9-6afc-41da-bf36-be2aab33f314',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.502648] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.503191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.510582] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ba8ccf9-6afc-41da-bf36-be2aab33f314 with status ACTIVE [ 1051.510743] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.510854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.510920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.511158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.511243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.511438] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.511555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.512037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.512037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.512037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.512202] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.512202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.512347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.512347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.512429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.513361] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ba8ccf9-6afc-41da-bf36-be2aab33f314 is going to be updated. [ 1051.536736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.536873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.536915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.537114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.537251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.537408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba8ccf9-6afc-41da-bf36-be2aab33f314" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.693408] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1051.693719] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 1051.693911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.694197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.694528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.694817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.695388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.695564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.695850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.696025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.696209] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.198970] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.312624] env[65443]: INFO networking_nsxv3.common.synchronization [None req-5a0ac316-3ae9-44cf-bbb3-4c04f38e2e2f None None] Enqueued Resource ID: b28244b7-02e7-4a8e-a4c0-9fdbdcf26657 with Priority: HIGHEST for action port [ 1052.313276] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b28244b7-02e7-4a8e-a4c0-9fdbdcf26657 with Priority: HIGHEST for action port [ 1052.313689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b28244b7-02e7-4a8e-a4c0-9fdbdcf26657 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.313689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b28244b7-02e7-4a8e-a4c0-9fdbdcf26657" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.313689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b28244b7-02e7-4a8e-a4c0-9fdbdcf26657" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.313928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b28244b7-02e7-4a8e-a4c0-9fdbdcf26657" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.314022] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b28244b7-02e7-4a8e-a4c0-9fdbdcf26657',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.702591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.816749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b28244b7-02e7-4a8e-a4c0-9fdbdcf26657 [ 1052.817732] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.817732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.817732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.817732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.817732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.817732] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b28244b7-02e7-4a8e-a4c0-9fdbdcf26657 already deleted. [ 1052.817732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b28244b7-02e7-4a8e-a4c0-9fdbdcf26657" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.203741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.203914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.203988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.204221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.204312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.204440] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1053.235020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.235180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.235232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.235443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.235586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.245640] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1055.255786] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1055.256060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.256163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.256366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.256550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.256667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.256733] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.256905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.257011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.257123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.257228] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.761637] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.761794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.761865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.762098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.762261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.762383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.762473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.762641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.762736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.762887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.762977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.763077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.763140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.763282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.763419] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.763511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.763570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.763703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.763778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.763860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.763948] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.265886] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca7259b9-1e79-42d6-87f5-2acdaf792fd0: rpc.has_security_group_logging(os_id): False [ 1056.288516] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.288683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.288807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.289585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.289585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.289585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.289856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.289856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.289954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.289999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.290216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.290364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.290364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.290513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.290585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.290808] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.290926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.290977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.291145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.291221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.291528] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1056.385827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.386059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.386059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.386351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.386351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.404091] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1057.314389] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1057.314389] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1057.477511] env[65443]: INFO networking_nsxv3.common.synchronization [req-4e5b9dc7-23a4-4b16-99de-47b726c6b7c1 req-e291ac8e-6fe0-4b94-8b08-1b1d6049c7d5 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1057.477700] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1057.478138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.478376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.478525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.480163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.480465] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.480692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.481023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.481118] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.481275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.482689] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.818990] env[65443]: INFO networking_nsxv3.common.synchronization [req-bce8042d-dd8d-4966-b760-7c0d2ad5891f req-d1e5b969-de81-4300-8d85-9749a7927981 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1057.819743] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1057.820199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.820390] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.820473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.820869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.821252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.821377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.821377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.821574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.821690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.821819] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.985032] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.219737] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.219941] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.220074] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.220337] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.220588] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.220743] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.220921] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.221076] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.221218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.221426] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.221538] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1058.221644] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1058.221749] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1058.221888] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1058.221960] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1058.222102] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1058.242686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1058.242860] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1058.242976] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1058.243176] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.243483] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-ae175f39-4703-49e7-821c-bfff3379753a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.243654] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.243770] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.244116] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.244253] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae175f39-4703-49e7-821c-bfff3379753a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.325142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.325536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.325536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.325800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.325961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.326261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.326402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.326531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.326769] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.326868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.326965] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 already deleted. [ 1058.327078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.417765] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1058.418031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.488198] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.747593] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.747915] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.748087] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.748475] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.748679] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.748891] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port ae175f39-4703-49e7-821c-bfff3379753a not found, creating... [ 1058.749306] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.749545] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.749734] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.750090] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.750325] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.750766] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.751015] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.751218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.751541] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.751758] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.751980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: ae175f39-4703-49e7-821c-bfff3379753a is going to be created. [ 1058.772404] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.772840] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.773130] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.773623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.774052] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.774536] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.991302] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.991494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.991535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.991755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.991853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.991953] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1059.028362] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.028560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.028560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.028775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.028956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.038816] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1059.507711] env[65443]: INFO networking_nsxv3.common.synchronization [req-bce8042d-dd8d-4966-b760-7c0d2ad5891f req-f45bd65e-f267-4ed3-aaff-3634120101e7 service nova] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1059.507968] env[65443]: INFO networking_nsxv3.common.synchronization [req-bce8042d-dd8d-4966-b760-7c0d2ad5891f req-f45bd65e-f267-4ed3-aaff-3634120101e7 service nova] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1059.508145] env[65443]: INFO networking_nsxv3.common.synchronization [req-bce8042d-dd8d-4966-b760-7c0d2ad5891f req-f45bd65e-f267-4ed3-aaff-3634120101e7 service nova] Enqueued Resource ID: ae175f39-4703-49e7-821c-bfff3379753a with Priority: HIGHEST for action port [ 1059.508733] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_rules [ 1059.508890] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1059.509046] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae175f39-4703-49e7-821c-bfff3379753a with Priority: HIGHEST for action port [ 1059.509359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.509520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.509684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.509913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.510028] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.511013] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.511156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.511245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.511458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.511617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.511737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.511807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.511992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.512111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.512210] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.513733] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae175f39-4703-49e7-821c-bfff3379753a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.513879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.513960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.514162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.514252] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae175f39-4703-49e7-821c-bfff3379753a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.017137] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.017137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.017137] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.017980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae175f39-4703-49e7-821c-bfff3379753a with status ACTIVE [ 1060.018234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.018692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.018692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.018692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.018817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.019027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.019193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.019266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.019447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.019538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.019736] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.019900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.020113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.020198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.020226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.020327] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae175f39-4703-49e7-821c-bfff3379753a is going to be updated. [ 1060.062648] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.062910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.062910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.063143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.063222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.063387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae175f39-4703-49e7-821c-bfff3379753a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.522857] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.025671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.026047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.026047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.026168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.026274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.026606] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 is going to be created. [ 1061.048769] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1061.049131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.055305] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.055910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.055910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.055910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.056154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.067151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: UNINITIALIZED for 2s [ 1061.618244] env[65443]: INFO networking_nsxv3.common.synchronization [req-a986eae1-498f-49b0-8155-138c12726418 req-cfaf1c01-9aa6-4b85-9cc5-af7e1dd2ded3 tempest-ServerRescueTestJSON-647095704 tempest-ServerRescueTestJSON-647095704-project-member] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1061.618790] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGHEST for action security_group_members [ 1061.619121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.619406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.619406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.619526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.619706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.619801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.619870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.619964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.620164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.620268] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.126733] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.126986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.127113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.127340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.127442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.127650] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.127802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.127871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.128044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.128126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.128212] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be updated. [ 1062.175214] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.175474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.175474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.175813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.175891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.187872] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: IN_PROGRESS for 2s [ 1063.077431] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: SUCCESS [ 1063.077868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.077990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.078467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.078581] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.078732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.078803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.079089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.079199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.079299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.079408] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.582267] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.947217] env[65443]: INFO networking_nsxv3.common.synchronization [req-e588711d-ad92-4b49-ab8c-56394379637f req-e4cd8ce9-8021-440a-9044-8aa2e6af6570 tempest-InstanceActionsV221TestJSON-1723493104 tempest-InstanceActionsV221TestJSON-1723493104-project-member] Enqueued Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1063.947671] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1063.947983] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.948208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.948208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.948453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.948608] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.948709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.948773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.948920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.949013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.949107] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.085278] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d0b13ed0-b04f-4117-97c4-0a86ea93c1b1: rpc.has_security_group_logging(os_id): False [ 1064.105019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.105273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.105385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.105649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.105743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.106014] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.106135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.106202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.106367] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.106450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.106542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 is going to be created. [ 1064.170343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.170343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.170343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.170631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.170679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.182630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: IN_PROGRESS for 2s [ 1064.199290] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5bfca26-c658-4447-930a-98eaefa1aa11 in Status: SUCCESS [ 1064.199290] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 deletion is rescheduled due to dependency. [ 1064.199392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.326081] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-986 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.326081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-986" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.326081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-986" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.326081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-986" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.330571] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.330571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.330571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.330571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.330571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.330571] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.330571] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.330571] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.330571] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.330571] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.330571] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.330571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.359489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.360700] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.360700] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.360700] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-986" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.361553] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-a033c044-4510-4f88-b230-247bc5811353 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.362052] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.362247] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.363807] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.363807] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a033c044-4510-4f88-b230-247bc5811353',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.453502] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.453502] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.453502] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 already deleted. [ 1064.453502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.868226] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.868487] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.868621] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.868928] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.869114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.869278] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port a033c044-4510-4f88-b230-247bc5811353 not found, creating... [ 1064.869543] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.869780] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.870054] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.870194] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.870300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.870573] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.870743] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.870860] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.871121] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.871262] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.871398] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: a033c044-4510-4f88-b230-247bc5811353 is going to be created. [ 1064.893605] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.893816] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.893939] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.894221] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.894788] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.895094] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.671258] env[65443]: INFO networking_nsxv3.common.synchronization [req-e588711d-ad92-4b49-ab8c-56394379637f req-91b44480-1134-4ba4-aa17-a42d71249975 service nova] Enqueued Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_rules [ 1065.671489] env[65443]: INFO networking_nsxv3.common.synchronization [req-e588711d-ad92-4b49-ab8c-56394379637f req-91b44480-1134-4ba4-aa17-a42d71249975 service nova] Enqueued Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1065.671517] env[65443]: INFO networking_nsxv3.common.synchronization [req-e588711d-ad92-4b49-ab8c-56394379637f req-91b44480-1134-4ba4-aa17-a42d71249975 service nova] Enqueued Resource ID: a033c044-4510-4f88-b230-247bc5811353 with Priority: HIGHEST for action port [ 1065.672240] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_rules [ 1065.672389] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1065.672533] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a033c044-4510-4f88-b230-247bc5811353 with Priority: HIGHEST for action port [ 1065.673439] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.673649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.673727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.673993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.674092] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.675078] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.675276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.675349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.675615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.675908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.676108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.676188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.676421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.676506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.676612] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.677997] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a033c044-4510-4f88-b230-247bc5811353 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.678121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.678121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.678296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.678367] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a033c044-4510-4f88-b230-247bc5811353',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.179333] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.180229] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.180363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.180716] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a033c044-4510-4f88-b230-247bc5811353 with status ACTIVE [ 1066.180885] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.180995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.181069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.181287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.181400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.181598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.181736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.181810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.182350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.182350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.182350] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.182350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.183283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.183283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.183283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.183283] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a033c044-4510-4f88-b230-247bc5811353 is going to be updated. [ 1066.197425] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: SUCCESS [ 1066.197644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.205534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.205534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.205534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.205798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.205860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.206033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a033c044-4510-4f88-b230-247bc5811353" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.682323] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.185278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.185446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.185549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.185732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.185824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.185920] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 is going to be created. [ 1067.210063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.210207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.210278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.210480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.210643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.220405] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: UNINITIALIZED for 2s [ 1069.233534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: UNINITIALIZED for 4s [ 1069.789043] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ee4d54d-79ca-423a-8c25-c3164b4cc013 req-368a3f7b-0687-408d-b3fb-8e516bd282d3 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1069.789675] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1069.789938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.790109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.791025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.791025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.791515] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.234619] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.235064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.235128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.235646] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.236836] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.237068] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.237290] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.237660] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.237942] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.238252] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.238458] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.238665] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.238879] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.239101] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1070.239299] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.239536] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.261047] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.261204] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1070.261352] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.261522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.261850] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-21eb8484-89d5-4afe-a59a-ea490786948f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.262026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.262157] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.262507] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.262658] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eb8484-89d5-4afe-a59a-ea490786948f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.293565] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.293919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.294131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.294386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.294655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.295009] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.295239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.295309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.295481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.295568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.295661] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be deleted. [ 1070.329817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.330022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.330101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.330287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.330374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.330486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.765542] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.765853] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.766906] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.766906] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.766906] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.766906] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 21eb8484-89d5-4afe-a59a-ea490786948f not found, creating... [ 1070.766906] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.767288] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.767288] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.767486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.767628] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.767918] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.772029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.772029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.772029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.772029] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.772029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 21eb8484-89d5-4afe-a59a-ea490786948f is going to be created. [ 1070.791070] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.791304] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.791396] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.791850] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.792123] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.792367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.250837] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: SUCCESS [ 1071.251326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.251326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.251441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.251649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.251771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.251839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.251997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.252089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.252195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.252294] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ee4d54d-79ca-423a-8c25-c3164b4cc013 req-ee9ef603-8bbf-46b2-acb5-3eab4d43ab67 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ee4d54d-79ca-423a-8c25-c3164b4cc013 req-ee9ef603-8bbf-46b2-acb5-3eab4d43ab67 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ee4d54d-79ca-423a-8c25-c3164b4cc013 req-ee9ef603-8bbf-46b2-acb5-3eab4d43ab67 service nova] Enqueued Resource ID: 21eb8484-89d5-4afe-a59a-ea490786948f with Priority: HIGHEST for action port [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1071.571599] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21eb8484-89d5-4afe-a59a-ea490786948f with Priority: HIGHEST for action port [ 1071.571975] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.571975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.572134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.573041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.573041] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.573699] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.573699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.573820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.577019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.577019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-21eb8484-89d5-4afe-a59a-ea490786948f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.577019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.577019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21eb8484-89d5-4afe-a59a-ea490786948f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.755198] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.755813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.756822] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.757235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.762019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.762019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.762019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.080619] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.080826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.081114] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.086306] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21eb8484-89d5-4afe-a59a-ea490786948f with status ACTIVE [ 1072.086512] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.086633] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.086702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.086913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.086994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.087184] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.087281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.087344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.087494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.087566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.087763] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.087828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.087892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.088035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.088112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.088195] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21eb8484-89d5-4afe-a59a-ea490786948f is going to be updated. [ 1072.115287] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.115437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.115487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.115789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.115941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.117105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21eb8484-89d5-4afe-a59a-ea490786948f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.265899] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2: rpc.has_security_group_logging(os_id): False [ 1072.293724] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.293962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.294078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.294274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.294366] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.294739] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.294877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.294951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.295192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.295284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.295585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.295975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.295975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.295975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.296107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.297339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.297339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.297339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.297339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.297339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.297339] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 is going to be created. [ 1072.368499] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.368499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.368499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.368499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.368767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.387463] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: IN_PROGRESS for 2s [ 1072.587737] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.665660] env[65443]: INFO networking_nsxv3.common.synchronization [req-491cdc51-b29f-4a32-802a-5b3335e951e6 req-87fd2e0f-4a9a-40ee-8e58-87ac1795d6e8 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1072.665926] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1072.666824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.667744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.667831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.668054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.668217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.668318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.668382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.668537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.668627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.668719] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.088856] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.089057] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.089168] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.089421] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.089656] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.089796] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.089908] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.090126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.090273] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.090461] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.090565] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.090670] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.090770] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.090872] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.090969] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.091105] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.092969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.092969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.093151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.093204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.093355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.093355] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be created. [ 1073.120849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.120849] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.121095] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.121689] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.121689] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-250fe1e3-5afe-4112-a3c1-f190cac6edd9 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.121862] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.121988] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.122574] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.122802] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250fe1e3-5afe-4112-a3c1-f190cac6edd9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.129302] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.129814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.129814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.130117] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.130351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.148560] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: UNINITIALIZED for 2s [ 1073.171633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.171791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.171791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.172775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.172775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.172775] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.172775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.172775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.173036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.173036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.173036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1073.202894] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.202894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.202894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.204260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.204260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.214948] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1073.626328] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.626660] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.626764] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.627100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.627289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.627464] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 250fe1e3-5afe-4112-a3c1-f190cac6edd9 not found, creating... [ 1073.628081] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.628081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.628081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.628358] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.628520] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.628842] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.629031] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.629161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.629445] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.629623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.629778] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 250fe1e3-5afe-4112-a3c1-f190cac6edd9 is going to be created. [ 1073.662255] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.662503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.662761] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.663132] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.663377] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.663606] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.407340] env[65443]: INFO networking_nsxv3.common.synchronization [req-491cdc51-b29f-4a32-802a-5b3335e951e6 req-3fcfaab8-9d87-4f61-bced-17ab3a77782e service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1074.407509] env[65443]: INFO networking_nsxv3.common.synchronization [req-491cdc51-b29f-4a32-802a-5b3335e951e6 req-3fcfaab8-9d87-4f61-bced-17ab3a77782e service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1074.407695] env[65443]: INFO networking_nsxv3.common.synchronization [req-491cdc51-b29f-4a32-802a-5b3335e951e6 req-3fcfaab8-9d87-4f61-bced-17ab3a77782e service nova] Enqueued Resource ID: 250fe1e3-5afe-4112-a3c1-f190cac6edd9 with Priority: HIGHEST for action port [ 1074.408914] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: SUCCESS [ 1074.409255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.409980] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1074.410250] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1074.410314] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 250fe1e3-5afe-4112-a3c1-f190cac6edd9 with Priority: HIGHEST for action port [ 1074.411111] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.411247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.411318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.411559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.411652] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.412740] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.412853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.413208] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-250fe1e3-5afe-4112-a3c1-f190cac6edd9 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.413332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.413332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.413547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.413651] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('250fe1e3-5afe-4112-a3c1-f190cac6edd9',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.916655] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.916942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.917243] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 250fe1e3-5afe-4112-a3c1-f190cac6edd9 with status ACTIVE [ 1074.917453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.917581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.917663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.917860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.917947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.918154] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.918254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.918318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.918479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.918574] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.918768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.918854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.918915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.919056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.919131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.919209] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 250fe1e3-5afe-4112-a3c1-f190cac6edd9 is going to be updated. [ 1074.946091] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.946211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.946248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.946454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.946601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.947132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-250fe1e3-5afe-4112-a3c1-f190cac6edd9" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.160280] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1075.160280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.160496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.160585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.161012] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.161162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.161241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.161437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.161531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.161627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.161730] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.225781] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1075.225952] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1075.226085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.226250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.226464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.226653] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.226820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.226928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.227120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.227206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.227301] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.665266] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.665266] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.665266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.665600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.665600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.665600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.665600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.665731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.665868] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.665933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.666078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.666142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.666224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.666307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.666898] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.712970] env[65443]: INFO networking_nsxv3.common.synchronization [req-dfddc4fb-e2e3-482a-bd5e-200f08d54944 req-a2634abf-36ff-405e-82f0-08341e5dcd1c tempest-ImagesTestJSON-1506792096 tempest-ImagesTestJSON-1506792096-project-member] Enqueued Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1075.713601] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 with Priority: HIGHEST for action security_group_members [ 1075.714429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.714728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.714840] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.715059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.715228] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.715330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.715394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.715543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.715709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.715818] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca7259b9-1e79-42d6-87f5-2acdaf792fd0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.730317] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.168937] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e276458-6ae4-4b43-8889-3fac24210880: rpc.has_security_group_logging(os_id): False [ 1076.190889] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.190889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.190889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.191146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.191146] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.191288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.191386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.191446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.191593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.191669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.191836] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.191927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.191986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.192132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.192204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.192373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.192487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.192552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.192652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.192725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.192805] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be created. [ 1076.220937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.220937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.220937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.221191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.221191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.221865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.221865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.221865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.221865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.221865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.221865] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 is going to be updated. [ 1076.232971] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.251319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.251458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.251695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.252112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.252112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.265650] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: IN_PROGRESS for 2s [ 1076.267741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.268046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.268195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.268814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.268814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.283073] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1076.735709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.735912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.735992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.736224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.736317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.736469] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1076.767687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.767905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.767952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.768257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.768484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.780729] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1076.945817] env[65443]: INFO networking_nsxv3.common.synchronization [None req-852e6cb8-50af-4e1b-896f-13180f89bdb6 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1076.946379] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1076.946685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.946818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.946887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.947340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.947505] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.947610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.947674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.947877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.947910] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.948016] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.291234] env[65443]: INFO networking_nsxv3.common.synchronization [req-491053bf-712f-43df-836c-0468ec281c4c req-5aad841e-46b2-4716-b689-97bb686d749b tempest-InstanceActionsV221TestJSON-1723493104 tempest-InstanceActionsV221TestJSON-1723493104-project-member] Enqueued Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1077.291930] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 with Priority: HIGHEST for action security_group_members [ 1077.292254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.292393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.292465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.292735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.292860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.292958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.293033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.293184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.293269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.293366] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.450508] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.497909] env[65443]: INFO networking_nsxv3.common.synchronization [req-6507dab2-2ee2-4af2-be0e-a4bebf221b15 req-eea5482d-74eb-4ef2-8d6e-9ba76ea01b68 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1077.498406] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1077.498672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.499340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.499340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.499340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.499340] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.499340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.499636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.499636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.499636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.499725] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.795610] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.795851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.795958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.796261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.796391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.796666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.796813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.796945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.797156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.797269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.797396] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 is going to be updated. [ 1077.817390] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.817644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.817821] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.818107] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.818379] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.818534] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.818649] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.818865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.819014] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.819233] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.819343] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.819485] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.819602] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.819715] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.819816] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.819945] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.856193] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.856418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.856475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.856692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.856853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.858814] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.858992] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.859127] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.859344] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.859592] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-8dac8446-1124-49e5-b00d-eeadb485b789 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.859758] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.859874] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.860386] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.860386] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dac8446-1124-49e5-b00d-eeadb485b789',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.876220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: IN_PROGRESS for 2s [ 1077.952838] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.002246] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.279669] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 in Status: SUCCESS [ 1078.279984] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca7259b9-1e79-42d6-87f5-2acdaf792fd0 deletion is rescheduled due to dependency. [ 1078.280182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca7259b9-1e79-42d6-87f5-2acdaf792fd0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.304257] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1078.304696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.364435] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.364818] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.365429] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.365429] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.365429] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.365722] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 8dac8446-1124-49e5-b00d-eeadb485b789 not found, creating... [ 1078.366043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.366314] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.366543] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.366950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.367150] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.367618] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.367876] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.368076] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.368455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.368674] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.368905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 8dac8446-1124-49e5-b00d-eeadb485b789 is going to be created. [ 1078.398517] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.398888] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.398987] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.399428] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.399856] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.400186] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.455500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.455740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.455740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.455962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.456062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.456135] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1078.505185] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.513917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.513917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.513917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.513917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.514463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.526910] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1078.792696] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1078.792696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.792905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.793068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.793245] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.793376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.793447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.793658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.793713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.793779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.793879] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.007671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.007916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.007916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.008152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.008244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.008360] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1079.038841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.039073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.039662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.039662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.039850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.050878] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1079.116990] env[65443]: INFO networking_nsxv3.common.synchronization [req-6507dab2-2ee2-4af2-be0e-a4bebf221b15 req-4609be74-fab0-464a-a3b5-a78f86803d52 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1079.117425] env[65443]: INFO networking_nsxv3.common.synchronization [req-6507dab2-2ee2-4af2-be0e-a4bebf221b15 req-4609be74-fab0-464a-a3b5-a78f86803d52 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1079.117425] env[65443]: INFO networking_nsxv3.common.synchronization [req-6507dab2-2ee2-4af2-be0e-a4bebf221b15 req-4609be74-fab0-464a-a3b5-a78f86803d52 service nova] Enqueued Resource ID: 8dac8446-1124-49e5-b00d-eeadb485b789 with Priority: HIGHEST for action port [ 1079.117940] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1079.118089] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1079.118190] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8dac8446-1124-49e5-b00d-eeadb485b789 with Priority: HIGHEST for action port [ 1079.119045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.119179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.119250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.119457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.119544] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.120630] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.120630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.120709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8dac8446-1124-49e5-b00d-eeadb485b789 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.120768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.120942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.121016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.121103] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8dac8446-1124-49e5-b00d-eeadb485b789',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.198187] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.198393] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.198495] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.198795] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.199008] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.199175] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.199290] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.199498] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.199639] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.199949] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.199949] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.200092] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.200170] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.200274] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.200375] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.200504] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.218835] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.219056] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.219152] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.219325] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.219656] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-f520a252-c0cf-49c4-83bd-f14142769755 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.219839] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.219959] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.220332] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.220442] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f520a252-c0cf-49c4-83bd-f14142769755',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.296579] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.296789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.296789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.297038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.297236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.297299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.297351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.297505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.297592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.298814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.298814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.298814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.298814] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.622878] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.623271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.625469] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8dac8446-1124-49e5-b00d-eeadb485b789 with status ACTIVE [ 1079.625820] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.625965] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.626179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.626417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.626562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.626693] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.626793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.626880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.627095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.627226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.627500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.627816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.627816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.627966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.627966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.628029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8dac8446-1124-49e5-b00d-eeadb485b789 is going to be updated. [ 1079.650899] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.651148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.651278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.651582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.651788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.652058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8dac8446-1124-49e5-b00d-eeadb485b789" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.723469] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.723792] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.723946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.724227] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.724553] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.724553] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port f520a252-c0cf-49c4-83bd-f14142769755 not found, creating... [ 1079.724867] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725152] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.725368] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.725501] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.725810] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725969] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.726101] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.726346] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.726435] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.726573] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: f520a252-c0cf-49c4-83bd-f14142769755 is going to be created. [ 1079.768291] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.768541] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.768673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.768946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.769418] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.769740] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.801928] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1079.823150] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.823315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.823349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.823565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.823661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.823874] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.824094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.824094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.824228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.824303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.824475] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.824569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.824673] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.824794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.824869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.825070] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.825164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.825222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.825365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.825429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.825523] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1079.888905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 in Status: SUCCESS [ 1079.889238] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2 deletion is rescheduled due to dependency. [ 1079.889421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.949361] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.949648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.949648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.949855] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.950031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.976336] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1080.506677] env[65443]: INFO networking_nsxv3.common.synchronization [req-00890294-17cc-42a1-89b9-ab5aa5acaab4 req-7e9320c8-0dfb-46ef-bd6f-9e9ee9d3ff78 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1080.506855] env[65443]: INFO networking_nsxv3.common.synchronization [req-00890294-17cc-42a1-89b9-ab5aa5acaab4 req-7e9320c8-0dfb-46ef-bd6f-9e9ee9d3ff78 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1080.506990] env[65443]: INFO networking_nsxv3.common.synchronization [req-00890294-17cc-42a1-89b9-ab5aa5acaab4 req-7e9320c8-0dfb-46ef-bd6f-9e9ee9d3ff78 service nova] Enqueued Resource ID: f520a252-c0cf-49c4-83bd-f14142769755 with Priority: HIGHEST for action port [ 1080.507553] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1080.507686] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1080.507793] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f520a252-c0cf-49c4-83bd-f14142769755 with Priority: HIGHEST for action port [ 1080.508078] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.508271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.508339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.508533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.508625] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.509475] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.509581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.509764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f520a252-c0cf-49c4-83bd-f14142769755 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.509881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.509936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.510089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.510174] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f520a252-c0cf-49c4-83bd-f14142769755',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.537984] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1080.538220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.538355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.538568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.538751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.538866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.538930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.539107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.539186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.539294] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.013013] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.013013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.013013] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f520a252-c0cf-49c4-83bd-f14142769755 with status ACTIVE [ 1081.013013] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.013013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.013013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.013580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.013580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.013687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.013784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.013846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.014025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.014111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.014303] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.014433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.015129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.015129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.015129] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.015129] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f520a252-c0cf-49c4-83bd-f14142769755 is going to be updated. [ 1081.038963] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.039154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.039154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.039336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.039469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.039630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f520a252-c0cf-49c4-83bd-f14142769755" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.040991] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.062332] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1081.062652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.062846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.063090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.063272] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.063392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.063459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.063618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.063768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.063920] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.543306] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.567811] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.996800] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1081.997132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.046371] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.046783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.046783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.046864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.046901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.046982] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1082.069900] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.077830] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.078056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.078131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.078404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.078596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.089394] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1082.573018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.573249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.573321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.573542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.573650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.573769] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1082.604483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.605223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.605223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.605223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.605426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.615576] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1084.101597] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1084.101996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.102107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.102278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.102535] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.102635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.102711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.102891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.102975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.103091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.103202] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.606677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.606677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.606677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.606902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.607526] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.607526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.607526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.607526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.608029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.608029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.608029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.608029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.608029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.608325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.608325] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.608325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.608325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.608499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.608540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.609141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.609141] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.627432] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1084.627693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.628237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.628487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.628728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.629084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.629084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.631563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.631563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.631563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.631563] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.110911] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e276458-6ae4-4b43-8889-3fac24210880: rpc.has_security_group_logging(os_id): False [ 1085.130020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.130177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.130249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.130455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.130541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.130763] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.130919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.130919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.131081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.131158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.131334] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.131426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.131488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.131624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.131695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.131869] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.131959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.132038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.132177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.132264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.132350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1085.133739] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.133832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.133832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.133997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.134136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.134246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.134318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.134476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.134552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.134696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.134856] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.134947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.136106] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.136106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.136106] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.199970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.200186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.200235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.200470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.200630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.213650] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1085.508811] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1085.509143] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1085.640278] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 1085.658423] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.658423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.659219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.659219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.678796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.679091] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.679213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.679269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.679461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.679544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.679738] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.679845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.679904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.680041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.680115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.680294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.680387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.680449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.680585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.680659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.680742] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1085.769525] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.769525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.769525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.769525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.769525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.781515] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1087.230643] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1087.231197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.397663] env[65443]: INFO networking_nsxv3.common.synchronization [None req-26c54392-dbfe-46f5-aefe-1005898b7c16 None None] Enqueued Resource ID: b1faa52a-1915-4a57-9ad7-9d9290febdb2 with Priority: HIGHEST for action port [ 1087.398375] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1faa52a-1915-4a57-9ad7-9d9290febdb2 with Priority: HIGHEST for action port [ 1087.398716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1faa52a-1915-4a57-9ad7-9d9290febdb2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.398870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1faa52a-1915-4a57-9ad7-9d9290febdb2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.398977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1faa52a-1915-4a57-9ad7-9d9290febdb2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.399290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1faa52a-1915-4a57-9ad7-9d9290febdb2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.399399] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1faa52a-1915-4a57-9ad7-9d9290febdb2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.797835] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1087.798142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.902879] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1faa52a-1915-4a57-9ad7-9d9290febdb2 [ 1087.903501] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.905191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.905191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.905191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.905191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.905191] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1faa52a-1915-4a57-9ad7-9d9290febdb2 already deleted. [ 1087.905191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1faa52a-1915-4a57-9ad7-9d9290febdb2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.463516] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.463840] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.463875] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.464126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.464386] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.464539] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.465059] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.465131] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.465327] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.465512] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.465581] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1089.465692] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1089.465817] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1089.465924] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1089.466041] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1089.466173] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1089.487749] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1089.487958] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1089.488061] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1089.488340] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.488776] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-2d51f333-e777-44b1-b392-f80d31bf5212 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.488966] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.489128] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.489422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.489551] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d51f333-e777-44b1-b392-f80d31bf5212',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.835998] env[65443]: INFO networking_nsxv3.common.synchronization [None req-97c019f5-82aa-476d-8e57-5703483e0109 None None] Enqueued Resource ID: f70e257c-faca-4a5e-84b9-ebb6e72cab69 with Priority: HIGHEST for action port [ 1089.836625] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f70e257c-faca-4a5e-84b9-ebb6e72cab69 with Priority: HIGHEST for action port [ 1089.837223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f70e257c-faca-4a5e-84b9-ebb6e72cab69 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.837317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f70e257c-faca-4a5e-84b9-ebb6e72cab69" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.837317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f70e257c-faca-4a5e-84b9-ebb6e72cab69" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.837597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f70e257c-faca-4a5e-84b9-ebb6e72cab69" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.837691] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f70e257c-faca-4a5e-84b9-ebb6e72cab69',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.993535] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.993535] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.993535] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.993973] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.994100] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.994427] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.994602] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.994886] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.995204] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.995357] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.995837] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.996082] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.996216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.996459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.996597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.996744] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 2d51f333-e777-44b1-b392-f80d31bf5212 is going to be updated. [ 1090.018758] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.018970] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.019096] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.019363] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.019557] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.019779] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.340867] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f70e257c-faca-4a5e-84b9-ebb6e72cab69 [ 1090.341179] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.341349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.341443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.341683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.341805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.341919] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f70e257c-faca-4a5e-84b9-ebb6e72cab69 already deleted. [ 1090.342029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f70e257c-faca-4a5e-84b9-ebb6e72cab69" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.734706] env[65443]: INFO networking_nsxv3.common.synchronization [req-e5c8b5ba-8f2c-4239-9b5a-c6a066890a67 req-0180ac28-1255-4242-82dd-ec89482cc584 service nova] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 1090.734935] env[65443]: INFO networking_nsxv3.common.synchronization [req-e5c8b5ba-8f2c-4239-9b5a-c6a066890a67 req-0180ac28-1255-4242-82dd-ec89482cc584 service nova] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 1090.735036] env[65443]: INFO networking_nsxv3.common.synchronization [req-e5c8b5ba-8f2c-4239-9b5a-c6a066890a67 req-0180ac28-1255-4242-82dd-ec89482cc584 service nova] Enqueued Resource ID: 2d51f333-e777-44b1-b392-f80d31bf5212 with Priority: HIGHEST for action port [ 1090.735544] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_rules [ 1090.735678] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 1090.735903] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d51f333-e777-44b1-b392-f80d31bf5212 with Priority: HIGHEST for action port [ 1090.737425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.737615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.737729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.737992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.738139] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.740697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.740915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.741032] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.741323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.743299] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.743299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.743299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.743299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.743299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.743299] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.744978] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d51f333-e777-44b1-b392-f80d31bf5212 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.745966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.746106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.746387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.746387] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d51f333-e777-44b1-b392-f80d31bf5212',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.865943] env[65443]: INFO networking_nsxv3.common.synchronization [req-0bde0022-20ae-4c7e-82ee-9a16e0d85a91 req-4c4c404d-a366-4735-804b-b3903b613d48 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1090.866503] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1090.866814] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.866936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.867147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.867378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.867536] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.867641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.867702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.867853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.867939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.868045] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.250322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.250533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.250704] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.251748] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d51f333-e777-44b1-b392-f80d31bf5212 with status ACTIVE [ 1091.251972] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.252115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.252232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.252429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.252559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.252763] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.252937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.252937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.253179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.253264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.254063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.254063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.254063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.254063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.254063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.254063] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d51f333-e777-44b1-b392-f80d31bf5212 is going to be updated. [ 1091.275507] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.275758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.275758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.275937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.276082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.276309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d51f333-e777-44b1-b392-f80d31bf5212" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.370635] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.756501] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.873427] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.259223] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.259438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.259555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.259900] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.260086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.260266] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be updated. [ 1092.306418] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.306648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.306648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.306847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.307033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.318698] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: IN_PROGRESS for 2s [ 1092.375796] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.376106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.376395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.376517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.376598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.376725] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1092.410180] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.410324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.410324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.411577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.411577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.420721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1094.339518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: SUCCESS [ 1094.339817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.339966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.340243] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.340479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.340668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.340748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.340932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.341024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.341125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.341422] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.433424] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1094.433641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.721072] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-bfd609dc-dcdc-4647-9d00-c6d5ee209ebb tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1094.721659] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1094.722188] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.722371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.722625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.722866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.723086] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.724109] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.724254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.724495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.724654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.724805] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.843422] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.226655] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.226819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.226895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.227343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.227443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.227646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.227749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.227814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.227967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.228064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.228243] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf already deleted. [ 1095.228375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.346899] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0497189d-9410-4586-bc37-f5d3774f6c57: rpc.has_security_group_logging(os_id): False [ 1095.370727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.370727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.370727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.370727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.406943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407313] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.407464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.407628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.407712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.407801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407880] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be updated. [ 1095.536652] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.537155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.537155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.537373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.537555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.561036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: IN_PROGRESS for 2s [ 1095.676800] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-d6469791-adb0-4a99-9d3b-8e54ee4eeb33 tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1095.677786] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1095.677786] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.677993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.677993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.678937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.679374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.679481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.679481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.679972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.679972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.679972] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.728934] env[65443]: INFO networking_nsxv3.common.synchronization [req-7a720c02-9d1e-4d93-96a9-bdfe4926c599 req-1ad540d5-5457-4c3b-8fc9-b0254be8da56 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1095.729443] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1095.729773] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.729911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.729981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.730338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.730338] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.730456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.730533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.730681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.730772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.730871] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.925020] env[65443]: INFO networking_nsxv3.common.synchronization [req-7facbf2c-e835-4d65-85fc-106a60637d24 req-370ebd4b-d9e9-45b4-af14-b3f854aa45fa tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1095.925020] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1095.925020] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.925469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.925705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.926038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.926457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.927723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.927723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.927723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.927723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.927723] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.132744] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-a6f69788-8b5f-46d1-9df6-a5e6f9c53f6f tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1096.133908] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1096.134313] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.134437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.184601] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.184803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.184867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.185166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.185271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.185483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.185617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.185716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.185905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.187286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf already deleted. [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.187286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.187286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.187708] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.236776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.236776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.236776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.236776] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1096.268387] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.268387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.268597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.268721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.268961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.284109] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1096.368392] env[65443]: INFO networking_nsxv3.common.synchronization [None req-6cf6af79-c061-41dd-b21a-504e6397878d tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1096.369149] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1096.369543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.369915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.432119] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.510043] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.510280] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.510280] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.511575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.511575] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.511575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.511575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.511575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.511575] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.511881] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.511881] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.511881] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.511984] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.512184] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.512339] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.512483] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.537318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.538021] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.538021] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.538021] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.538206] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-83cc6528-3599-4a83-b6bb-c9db78b24e2a taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.538335] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.538450] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.538858] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.539021] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cc6528-3599-4a83-b6bb-c9db78b24e2a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.692844] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.692844] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.693026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.693192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.693349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.693539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.693645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.693752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.693932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.694052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.694149] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf already deleted. [ 1096.694235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.940642] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.041834] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.042250] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.042412] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.042746] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.042899] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.043070] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 83cc6528-3599-4a83-b6bb-c9db78b24e2a not found, creating... [ 1097.043434] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.043608] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.043728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.044036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.044192] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.044560] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.044782] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.044916] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.045145] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.045279] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.045418] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 83cc6528-3599-4a83-b6bb-c9db78b24e2a is going to be created. [ 1097.069174] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.069429] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.069509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.069795] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.070034] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.070277] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.443701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.444108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.444108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.444108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.444214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.444290] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1097.474901] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.474901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.474901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.475186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.475393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.488368] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1097.576558] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: SUCCESS [ 1097.576784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.300618] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1098.300798] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 1098.300916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.351886] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-2cdb90c0-2b34-4a3c-8113-cd939c7c5310 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1098.351886] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-2cdb90c0-2b34-4a3c-8113-cd939c7c5310 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1098.351886] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-2cdb90c0-2b34-4a3c-8113-cd939c7c5310 service nova] Enqueued Resource ID: 83cc6528-3599-4a83-b6bb-c9db78b24e2a with Priority: HIGHEST for action port [ 1098.352498] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1098.352666] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1098.352809] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cc6528-3599-4a83-b6bb-c9db78b24e2a with Priority: HIGHEST for action port [ 1098.357025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.357025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.357025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.357025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.357025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.357710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.357710] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.358588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-83cc6528-3599-4a83-b6bb-c9db78b24e2a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.358703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.358768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.358931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.359025] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cc6528-3599-4a83-b6bb-c9db78b24e2a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.751064] env[65443]: INFO networking_nsxv3.common.synchronization [req-6b848d10-863b-4e3f-884f-f0a8c6ea5c50 req-852bf691-c4dc-4529-a62d-8014da5ae9c0 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1098.751653] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1098.751977] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.754980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.755066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.755296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.755479] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.755587] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.755652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.755806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.755892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.756294] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.861186] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.861382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.861661] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.863206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83cc6528-3599-4a83-b6bb-c9db78b24e2a with status ACTIVE [ 1098.863496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.863676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.863778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.864583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.864583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.864697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.864834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.864893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.865158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.865287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.865581] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.865752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.865967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.866057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.866176] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.866314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83cc6528-3599-4a83-b6bb-c9db78b24e2a is going to be updated. [ 1098.896157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.896157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.896157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.896157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.896157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.896157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83cc6528-3599-4a83-b6bb-c9db78b24e2a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.210811] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-289 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.211144] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-289" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.211324] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-289" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.211661] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-289" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.211956] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.212166] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.212295] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.212932] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.213114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.213330] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.213447] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1099.213597] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1099.213712] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1099.213833] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1099.213965] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1099.214186] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1099.235203] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1099.235203] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1099.235203] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1099.235203] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-289" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.235557] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-f871d92f-d0a8-45d7-a36b-5d310534d838 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.235557] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.235772] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.235997] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.236195] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f871d92f-d0a8-45d7-a36b-5d310534d838',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.260230] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.260446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.260529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.260771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.260891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.261108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.261221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.261271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.261415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.261517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.261641] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1099.312727] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.312985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.313075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.313431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.313657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.324526] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1099.369194] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.499668] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1099.499912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.500111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.500334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.500545] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.500706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.500771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.500973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.501086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.501186] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.739025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.740717] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port f871d92f-d0a8-45d7-a36b-5d310534d838 not found, creating... [ 1099.740717] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.740717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.741065] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.741156] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.741330] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.741446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.741649] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.741780] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.741916] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: f871d92f-d0a8-45d7-a36b-5d310534d838 is going to be created. [ 1099.764543] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.764896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.764998] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.765753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.765753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.765753] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.872407] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.872407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.872650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.872717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.872832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.872934] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be created. [ 1099.927439] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.927695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.927695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.928903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.928903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.939426] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: UNINITIALIZED for 2s [ 1100.004235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.004448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.004448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.004747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.004853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.005077] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.005183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.005267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.005479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.005560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.005648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1100.035666] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.035850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.035929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.036210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.036389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.045428] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1100.556216] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-b0ea37ba-06d4-4419-86bf-dca1670fbcf2 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1100.556398] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-b0ea37ba-06d4-4419-86bf-dca1670fbcf2 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1100.556534] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-b0ea37ba-06d4-4419-86bf-dca1670fbcf2 service nova] Enqueued Resource ID: f871d92f-d0a8-45d7-a36b-5d310534d838 with Priority: HIGHEST for action port [ 1100.557096] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1100.557276] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1100.557331] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f871d92f-d0a8-45d7-a36b-5d310534d838 with Priority: HIGHEST for action port [ 1100.557614] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.557721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.557924] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.558014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.558199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f871d92f-d0a8-45d7-a36b-5d310534d838 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.558299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.558362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.558561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.558646] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f871d92f-d0a8-45d7-a36b-5d310534d838',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.672485] env[65443]: INFO networking_nsxv3.common.synchronization [req-cd4c0776-7fbc-4f43-8c76-d0e451543b25 req-a8acc124-55fd-4ec1-be6f-a44cd45357f6 tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1100.674105] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1100.674105] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.674105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.674105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.674105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.674105] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.674439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.674439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.674439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.674608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.674777] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.035231] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-341 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.035738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.035738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.035895] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.036167] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.036362] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.036485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.036792] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.036995] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.037316] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.037438] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.037562] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.037675] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.037793] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.037898] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.038042] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.060850] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f871d92f-d0a8-45d7-a36b-5d310534d838 with status ACTIVE [ 1101.061377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.061523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.061599] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.061861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.061960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.062165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.062287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.062380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.062572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.062658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.062887] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.062991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.063067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.063209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.063284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.063370] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f871d92f-d0a8-45d7-a36b-5d310534d838 is going to be updated. [ 1101.065680] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.065893] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.066093] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.066218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-341" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.066622] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-0e02a345-ef28-41de-9102-41d5b6b5a192 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.066735] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.066865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.067235] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.067386] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e02a345-ef28-41de-9102-41d5b6b5a192',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.091196] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.091380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.091431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.091637] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.091766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.091921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f871d92f-d0a8-45d7-a36b-5d310534d838" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.178051] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.178051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.178051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.178051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.178051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.178495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.178495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.178495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.178607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.178863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.178863] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1101.220491] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.220636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.220682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.220879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.221038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.234198] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1101.336060] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-202 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.336264] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.336437] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.336784] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.337143] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.337301] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.337462] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.337785] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.338056] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.338230] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.338343] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.338451] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.338557] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.338701] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.338853] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.339008] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.340751] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1101.340929] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1101.341081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.361348] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.361513] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.361702] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.362048] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-202" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.362307] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.362489] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.362611] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.363107] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.363254] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba06478c-b8a7-4c24-b7b3-b724f3a85d0b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.569903] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.569903] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.570184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.570375] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.570530] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.570743] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 0e02a345-ef28-41de-9102-41d5b6b5a192 not found, creating... [ 1101.571039] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.571213] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.571340] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.571587] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.571728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.572058] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.575036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.575036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.575036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.575036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.575036] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 0e02a345-ef28-41de-9102-41d5b6b5a192 is going to be created. [ 1101.597718] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.597718] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.598251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.598251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.598391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.598658] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.866225] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.866538] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.866692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.866850] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.867134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.867290] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port ba06478c-b8a7-4c24-b7b3-b724f3a85d0b not found, creating... [ 1101.867558] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.867719] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.867864] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.868108] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.868259] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.868542] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.868699] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.868827] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.869042] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.869181] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.869323] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: ba06478c-b8a7-4c24-b7b3-b724f3a85d0b is going to be created. [ 1101.894844] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.895094] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.895586] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.895968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.896260] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.896537] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.956687] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.956687] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.956687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.956687] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.957491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.957695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.957910] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.958029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.958115] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.958271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.958352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.958444] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.059482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1102.059890] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 deletion is rescheduled due to dependency. [ 1102.059890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.314546] env[65443]: INFO networking_nsxv3.common.synchronization [req-cd4c0776-7fbc-4f43-8c76-d0e451543b25 req-61174eb7-12aa-4c64-a458-87cca946bba2 service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 1102.314820] env[65443]: INFO networking_nsxv3.common.synchronization [req-cd4c0776-7fbc-4f43-8c76-d0e451543b25 req-61174eb7-12aa-4c64-a458-87cca946bba2 service nova] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1102.315312] env[65443]: INFO networking_nsxv3.common.synchronization [req-cd4c0776-7fbc-4f43-8c76-d0e451543b25 req-61174eb7-12aa-4c64-a458-87cca946bba2 service nova] Enqueued Resource ID: 0e02a345-ef28-41de-9102-41d5b6b5a192 with Priority: HIGHEST for action port [ 1102.319039] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_rules [ 1102.319039] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1102.319039] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e02a345-ef28-41de-9102-41d5b6b5a192 with Priority: HIGHEST for action port [ 1102.319039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.319039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.319039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.319039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.319039] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.323325] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.323325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.323933] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e02a345-ef28-41de-9102-41d5b6b5a192 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.323933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.324110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.324333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.324485] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e02a345-ef28-41de-9102-41d5b6b5a192',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.460765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.461035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.461138] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.667103] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-72cfcc40-4525-4510-8da1-ffd88c804905 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1102.667400] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-72cfcc40-4525-4510-8da1-ffd88c804905 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1102.667641] env[65443]: INFO networking_nsxv3.common.synchronization [req-b78a9aa4-f101-4268-a4aa-1be40c74176f req-72cfcc40-4525-4510-8da1-ffd88c804905 service nova] Enqueued Resource ID: ba06478c-b8a7-4c24-b7b3-b724f3a85d0b with Priority: HIGHEST for action port [ 1102.668274] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1102.668470] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1102.668623] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba06478c-b8a7-4c24-b7b3-b724f3a85d0b with Priority: HIGHEST for action port [ 1102.669029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.669185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.669490] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.669625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.669907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.670080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.670194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.670476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.670606] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba06478c-b8a7-4c24-b7b3-b724f3a85d0b',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.826969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.829973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e02a345-ef28-41de-9102-41d5b6b5a192 with status ACTIVE [ 1102.829973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.829973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.829973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.829973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.830889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e02a345-ef28-41de-9102-41d5b6b5a192 is going to be updated. [ 1102.853286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.853483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.853681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.854502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.854502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.854502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e02a345-ef28-41de-9102-41d5b6b5a192" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.964640] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.173065] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba06478c-b8a7-4c24-b7b3-b724f3a85d0b with status ACTIVE [ 1103.173596] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.173596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.173596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.173772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.173843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.174048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.174145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.174206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.174360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.174441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.174617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.174710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.174897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.175143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.175253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.175356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba06478c-b8a7-4c24-b7b3-b724f3a85d0b is going to be updated. [ 1103.196309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.196490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.196551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.196705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.196837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.196997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba06478c-b8a7-4c24-b7b3-b724f3a85d0b" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.246145] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1103.246339] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 1103.246459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.246626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.246889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.247113] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.247240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.247306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.247470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.247551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.247645] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.466794] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.467430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.468180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.468180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.468180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.468358] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1103.501255] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.501476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.501476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.501671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.501817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.511060] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1103.750403] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.255754] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.757994] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.758192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.758230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.758451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.758732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.758904] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1104.790654] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.790654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.790654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.790654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.790654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.799283] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1104.849546] env[65443]: INFO networking_nsxv3.common.synchronization [req-be63d3c9-8402-47ca-86c0-50413ac32f17 req-3740a761-a5f2-427c-8948-b3996224c65d tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1104.849546] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1104.849546] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.849546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.849546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.850273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.850575] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.850797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.850950] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.851220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.851398] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.851579] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.211571] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.211768] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.211890] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.212170] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.212420] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.212573] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.212687] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.214069] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.214904] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.215171] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.215289] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.215399] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.215507] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.215615] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.215719] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.215852] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.236448] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.236630] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.236766] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.236946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-676" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.237291] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-c65f3151-24dd-48d8-a86c-f022864d7043 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.237463] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.237582] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.237934] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.238086] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c65f3151-24dd-48d8-a86c-f022864d7043',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.354377] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.448211] env[65443]: INFO networking_nsxv3.common.synchronization [req-85b0f34f-4258-49c0-82c4-3d7f0046e1c3 req-c542ab81-27f6-45c1-9436-57731f7f6844 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1105.448736] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGHEST for action security_group_members [ 1105.449054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.449182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.449250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.449449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.449599] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.449695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.449758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.449899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.449984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.450089] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.521187] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1105.521397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.521558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.521770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.521960] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.522096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.522153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.522302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.522383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.522467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.522686] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.522748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.522783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.522906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.523055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.523152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.523207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.523341] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.523416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.523489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.523576] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.524433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.524604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.524747] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.524888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.524929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.525085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.525171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.525255] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.740779] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.741162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.741162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.741421] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.741565] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.741739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port c65f3151-24dd-48d8-a86c-f022864d7043 not found, creating... [ 1105.742032] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.742332] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.742332] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.742523] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.742660] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.742981] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.743215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.743278] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.743502] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.743645] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.743784] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: c65f3151-24dd-48d8-a86c-f022864d7043 is going to be created. [ 1105.764851] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.765137] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.765215] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.765776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.765776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.765969] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.858115] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.952744] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.953051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.953184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.953486] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.953833] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.953833] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.954039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.954039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.954202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.954286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.954377] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384aae03-a82d-4592-a983-85af28dc063f is going to be updated. [ 1105.983823] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.984090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.984211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.984520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.985217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.997737] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: IN_PROGRESS for 2s [ 1106.026797] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57265bd0-8115-40d5-9d60-a57a4b18bbaf: rpc.has_security_group_logging(os_id): False [ 1106.028413] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.048776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.048935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.048993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.049216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.049302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.049489] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.049597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.049636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.049977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.049977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.050112] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.050162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.050203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.050320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.050394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.050613] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.050672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.050731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.050862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.050930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.051019] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be created. [ 1106.054731] env[65443]: INFO networking_nsxv3.common.synchronization [req-11992e7c-4f97-4f7a-a56a-949b1dc7b708 req-357fbd12-b5f3-406e-bcb0-fcc8602da546 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1106.055551] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGHEST for action security_group_members [ 1106.055897] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.056035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.056099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.056278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.056426] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.056518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.056578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.056717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.056801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.056891] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.121866] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.122076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.122180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.122404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.122593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.137777] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1106.361101] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.361960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.361960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.361960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.361960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.361960] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1106.399357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.399544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.399671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.399850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.400022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.412120] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1106.531793] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.543484] env[65443]: INFO networking_nsxv3.common.synchronization [req-be63d3c9-8402-47ca-86c0-50413ac32f17 req-f6d1de12-29d3-4783-b13b-15d5134b3c22 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1106.543484] env[65443]: INFO networking_nsxv3.common.synchronization [req-be63d3c9-8402-47ca-86c0-50413ac32f17 req-f6d1de12-29d3-4783-b13b-15d5134b3c22 service nova] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1106.543565] env[65443]: INFO networking_nsxv3.common.synchronization [req-be63d3c9-8402-47ca-86c0-50413ac32f17 req-f6d1de12-29d3-4783-b13b-15d5134b3c22 service nova] Enqueued Resource ID: c65f3151-24dd-48d8-a86c-f022864d7043 with Priority: HIGHEST for action port [ 1106.543754] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_rules [ 1106.544303] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1106.544303] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c65f3151-24dd-48d8-a86c-f022864d7043 with Priority: HIGHEST for action port [ 1106.545186] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.545186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.545607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.545779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.545932] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.547213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.547368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.547626] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-c65f3151-24dd-48d8-a86c-f022864d7043 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.548218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.548218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.548218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.548405] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c65f3151-24dd-48d8-a86c-f022864d7043',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.560431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.561379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.561747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.561747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.561859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.562154] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.563097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.563167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.563502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.563618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.563706] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 is going to be updated. [ 1106.594669] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.594862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.594912] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.595145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.595312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.604261] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: IN_PROGRESS for 2s [ 1106.812362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1106.812501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.812670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.812883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.813095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.813213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.813328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.813435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.813513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.813590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.813680] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.037074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.037074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.037245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.037433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.037481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.037569] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1107.051019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.051019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.051019] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c65f3151-24dd-48d8-a86c-f022864d7043 with status ACTIVE [ 1107.051019] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.051019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.051294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.051294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.051369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.051521] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.051610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.051668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.051809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.051880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.052429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.052429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.052429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.052429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.052429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.052888] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c65f3151-24dd-48d8-a86c-f022864d7043 is going to be updated. [ 1107.069677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.069807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.069896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.070077] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.070219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.074409] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.074591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.074629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.074850] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.074994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.075157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c65f3151-24dd-48d8-a86c-f022864d7043" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.079659] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1107.315528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.315887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.315970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.316267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.316501] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.316608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.316672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.316837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.316922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.317028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.317211] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.317288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.317351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.317566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.317710] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.317808] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.317873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.318070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.318070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.318227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.318282] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.820969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1d34e09-75e3-43fa-8d8c-5bb269633d94: rpc.has_security_group_logging(os_id): False [ 1107.839751] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.839903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.839961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.840196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.840286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.840548] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.840666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.840754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.840947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.841081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.841422] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.841693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.841785] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.841976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.842073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.842294] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.842506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.842591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.842755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.842908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.843093] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1107.943287] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.943604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.943604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.943802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.943953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.959362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1108.012847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 384aae03-a82d-4592-a983-85af28dc063f in Status: SUCCESS [ 1108.013276] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 384aae03-a82d-4592-a983-85af28dc063f deletion is rescheduled due to dependency. [ 1108.013276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.157056] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1108.157056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.157056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.157674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.157674] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.422794] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1108.423044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.423209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.423450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.423633] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.423763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.423820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.423975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.424069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.424177] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.614074] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 in Status: SUCCESS [ 1108.614243] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 deletion is rescheduled due to dependency. [ 1108.614368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.660429] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.660429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.926979] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.089494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1109.089734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.089996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090527] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.090583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.090619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.090766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.090851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.090944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.091058] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.429983] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.595128] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.595403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.595563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.595993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.596191] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.597131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.597215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.597393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.597501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.597607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.597764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.597862] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.597926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.598108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.600938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.600938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.600938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.600938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.600938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.600938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.600938] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.935282] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.935667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.935667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.935667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.936103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.936103] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1109.971918] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1109.972205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.973250] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.973382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.973499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.973644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.973791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.983737] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1110.104537] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57265bd0-8115-40d5-9d60-a57a4b18bbaf: rpc.has_security_group_logging(os_id): False [ 1110.125570] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.125741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.125741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.126057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.126178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.126450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.126591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.126679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.126885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.127042] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.127278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.127417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.127545] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.127655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.127732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.127936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.128046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.128106] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.128240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.128339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.128434] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1110.195462] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.195631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.195663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.195894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.196059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.210937] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1111.425024] env[65443]: INFO networking_nsxv3.common.synchronization [None req-986929b1-90a4-47e9-9d25-58de0daee623 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1111.425301] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1111.425543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.425663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.425776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.426156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.426275] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.537382] env[65443]: INFO networking_nsxv3.common.synchronization [None req-66c0690a-e42c-49dc-bf5c-3b4364d71062 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1111.537899] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1111.538235] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.538338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.946501] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.946501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.946501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.946501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.946730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.946730] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e already deleted. [ 1111.946730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.946887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.947081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.947165] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.992977] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1111.993229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.993405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.993667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.993841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.993968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.994033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.994220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.994264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.994350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.994440] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.227393] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1112.227713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.227927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.228237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.228821] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.470685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.471030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.471030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.471299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.471426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.471570] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e already deleted. [ 1112.471704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.496453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.496606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.496708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.496889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.497075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.497971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.498255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.498453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.498552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.498653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.498845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.498952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.499027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.499177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.499317] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.499426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.499489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.499626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.499702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.499784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.499890] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.733189] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.733355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.733428] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.733642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.733807] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.733907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.734018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.734188] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.734294] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.734384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.734477] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.777508] env[65443]: INFO networking_nsxv3.common.synchronization [req-5e9d20a4-a459-4b74-b2e4-9d1755783154 req-51b4011f-424f-418d-9850-8c698bf73d2f tempest-ServerDiskConfigTestJSON-655890156 tempest-ServerDiskConfigTestJSON-655890156-project-member] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1112.778458] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGHEST for action security_group_members [ 1112.778458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.779239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.779239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.779239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.779239] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.779239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.779239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.779512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.779512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.779512] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.002770] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 08bead38-748c-49c3-9386-219294620db2: rpc.has_security_group_logging(os_id): False [ 1113.024722] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.024998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.024998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.025244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.025339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.025560] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.025676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.025730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.025873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.025979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.026180] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.026298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.026357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.026505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.026560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.026709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.026800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.026859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.026999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.027184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.027320] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1113.145155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.145378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.145423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.145625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.145891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.168449] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1113.237555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.237799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.237799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.238045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.238300] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.238442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.238513] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.238798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.238798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.238959] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.239098] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.239225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.239266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.239421] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.239539] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.239655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.239721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.239890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.240014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.240140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.240239] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.283260] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.283260] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.283260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.283754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.283754] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be updated. [ 1113.322607] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.322716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.322830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.323069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.323211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.334014] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: IN_PROGRESS for 2s [ 1113.743628] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57265bd0-8115-40d5-9d60-a57a4b18bbaf: rpc.has_security_group_logging(os_id): False [ 1113.767400] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.767615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.767696] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.767886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.768063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.768185] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.768363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.768363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.768571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.768751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.768985] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.769110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.769192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.769689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.769689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.769689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.769689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.770027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.770027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.770027] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.770027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1113.872618] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.873560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.873560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.873560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.873560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.889884] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1113.947659] env[65443]: INFO networking_nsxv3.common.synchronization [None req-73fd48ec-de07-473f-a19f-a31bb14ee73e tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1113.948969] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1113.949136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.949297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.949351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.949662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.949755] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.049415] env[65443]: INFO networking_nsxv3.common.synchronization [None req-36ce9a87-2be6-47f0-914f-7fe3643cc04e tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1114.050174] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1114.050487] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.050594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.470943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.471155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.471155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.471331] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.471427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.471550] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 already deleted. [ 1114.471699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.471796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.471947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.472053] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.996083] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.996415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.996415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.996604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.996640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.996847] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 already deleted. [ 1114.996847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.184017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1115.184268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.343593] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 in Status: SUCCESS [ 1115.343770] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 deletion is rescheduled due to dependency. [ 1115.343894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.543333] env[65443]: INFO networking_nsxv3.common.synchronization [req-e39b94ce-22c7-465c-8d9b-6967b5b6701f req-bfbc2497-75f6-48e8-97ea-cf38183e8332 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1115.543992] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1115.545318] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.545560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.545656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.546239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.546708] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.546825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.546909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.547063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.547157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.547256] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.860840] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.861038] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.861175] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.861451] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.861737] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.861910] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.862049] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.862362] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.862485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.862682] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.862896] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.863015] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.863121] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.863230] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.863328] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.863522] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.882494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.882668] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.882809] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.882983] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.883326] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-1b32389a-9046-4598-a09b-abfa6bc27847 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.883503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.883718] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.884074] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.884216] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b32389a-9046-4598-a09b-abfa6bc27847',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.903720] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1115.903940] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.053144] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.053439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.053439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.053647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.053908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.054240] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.054416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.054532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.054800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.055071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.055193] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1116.083428] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.083562] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.083664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.084234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.084234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.095391] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1116.387218] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.387548] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.388072] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.388207] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.388467] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.388725] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 1b32389a-9046-4598-a09b-abfa6bc27847 not found, creating... [ 1116.389200] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.389480] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.389692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.390058] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.390304] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.390903] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.391066] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.391279] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.391629] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.391861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.392124] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 1b32389a-9046-4598-a09b-abfa6bc27847 is going to be created. [ 1116.420173] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.420459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.420644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.420974] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.421280] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.421593] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.115771] env[65443]: INFO networking_nsxv3.common.synchronization [req-e39b94ce-22c7-465c-8d9b-6967b5b6701f req-84464edc-6c7e-4eb2-828c-3d733217e120 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1117.116095] env[65443]: INFO networking_nsxv3.common.synchronization [req-e39b94ce-22c7-465c-8d9b-6967b5b6701f req-84464edc-6c7e-4eb2-828c-3d733217e120 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1117.116170] env[65443]: INFO networking_nsxv3.common.synchronization [req-e39b94ce-22c7-465c-8d9b-6967b5b6701f req-84464edc-6c7e-4eb2-828c-3d733217e120 service nova] Enqueued Resource ID: 1b32389a-9046-4598-a09b-abfa6bc27847 with Priority: HIGHEST for action port [ 1117.116695] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1117.116925] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1117.116970] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b32389a-9046-4598-a09b-abfa6bc27847 with Priority: HIGHEST for action port [ 1117.117307] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.117452] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.117522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.117763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.117941] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.118857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.118972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.119616] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b32389a-9046-4598-a09b-abfa6bc27847 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.119731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.119773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.119987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.120077] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b32389a-9046-4598-a09b-abfa6bc27847',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.622239] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.622813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.624997] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1b32389a-9046-4598-a09b-abfa6bc27847 with status ACTIVE [ 1117.625136] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.625272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.625340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.625582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.626564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.626564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.626564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.626860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.626860] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.626860] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1b32389a-9046-4598-a09b-abfa6bc27847 is going to be updated. [ 1117.650568] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.650743] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.650783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.650995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.651148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.651433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b32389a-9046-4598-a09b-abfa6bc27847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.855280] env[65443]: INFO networking_nsxv3.common.synchronization [req-9275d349-7d36-4841-a816-629697db51c1 req-18536fa0-b842-4655-831c-5baed0529ac7 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1117.855702] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1117.856048] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.856185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.856244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.856585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.856760] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.856870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.856935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.857110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.857200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.857353] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.913985] env[65443]: INFO networking_nsxv3.common.synchronization [req-a9fab243-0317-4236-b82a-e60a0636cf9c req-c95f8fbf-ac6c-4393-a25c-c5f6c69ec524 tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1117.914549] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1117.915032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.915144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.915228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.915416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.915569] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.915667] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.915729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.915886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.915958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.916072] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.154999] env[65443]: INFO networking_nsxv3.common.synchronization [req-a9fab243-0317-4236-b82a-e60a0636cf9c req-340e792e-e736-431f-b065-d90eef85a5bd tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1118.155552] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1118.155894] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.155992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.208681] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1118.208852] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1118.208967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.209504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.209720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.209907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.210036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.210099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.210244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.210321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.210417] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.225455] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.225662] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.225845] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.226148] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.226407] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.226562] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.226675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.226884] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.227111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.227355] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.227506] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1118.227640] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1118.227773] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1118.227908] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1118.228053] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1118.228218] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1118.268340] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1118.268633] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1118.268878] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1118.269271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.269771] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.270393] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.270845] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.271684] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.271895] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bc76608-3d96-47d8-92e9-00fd38a1d4f7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.363534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.363534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.363534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e already deleted. [ 1118.363534] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.418704] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.457315] env[65443]: INFO networking_nsxv3.common.synchronization [req-a9fab243-0317-4236-b82a-e60a0636cf9c req-663b1a89-07cf-4f92-a404-a029446cd90a tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1118.457733] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1118.458055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.458160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.713549] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.775756] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.776114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.776228] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.776545] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.776709] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.776877] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 not found, creating... [ 1118.777197] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.777396] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.777519] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.777751] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.777893] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.778388] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.778611] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.778761] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.779014] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.779197] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.779364] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 is going to be created. [ 1118.815487] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.815737] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.815846] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.816151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.816380] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.816610] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.920642] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.219022] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.423658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.423885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.423885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.424104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.424200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.424300] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1119.455824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.456081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.456228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.456459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.456639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.467489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1119.569684] env[65443]: INFO networking_nsxv3.common.synchronization [req-9275d349-7d36-4841-a816-629697db51c1 req-ab5fbb3f-a147-4b69-883a-b30b68702591 service nova] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1119.569801] env[65443]: INFO networking_nsxv3.common.synchronization [req-9275d349-7d36-4841-a816-629697db51c1 req-ab5fbb3f-a147-4b69-883a-b30b68702591 service nova] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1119.569928] env[65443]: INFO networking_nsxv3.common.synchronization [req-9275d349-7d36-4841-a816-629697db51c1 req-ab5fbb3f-a147-4b69-883a-b30b68702591 service nova] Enqueued Resource ID: 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 with Priority: HIGHEST for action port [ 1119.570486] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1119.570648] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1119.571029] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 with Priority: HIGHEST for action port [ 1119.571358] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.571500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.571601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.571887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.572024] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.575563] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.575563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.575563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.575563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.575563] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.576120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.576120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.576499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.576499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.576499] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.578446] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.578446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.578446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.579178] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.579178] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bc76608-3d96-47d8-92e9-00fd38a1d4f7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.652783] env[65443]: INFO networking_nsxv3.common.synchronization [req-bfde0a2d-603c-4534-b485-df98463ab0cc req-6e90557a-c6d2-4d25-aeea-a9b8b700f88d tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1119.653474] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1119.653797] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.653986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.653986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.654199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.654351] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.654451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.654512] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.654657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.654744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.654842] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.720278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.720431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.720503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.720758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.720805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.720905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1119.756041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.756192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.756305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.756502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.756728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.767885] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1120.075781] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.076031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.080490] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.081908] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 with status ACTIVE [ 1120.082530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.082530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.082530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.083326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.083326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.083505] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.083623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.084244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.084244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.084244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.084244] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.084592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.084592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.084592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.084592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.084785] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bc76608-3d96-47d8-92e9-00fd38a1d4f7 is going to be updated. [ 1120.107360] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.107360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.107544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.107616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.107732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.107899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bc76608-3d96-47d8-92e9-00fd38a1d4f7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.157563] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.587852] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.659835] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.090412] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.090602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.090677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.090916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.091025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.091132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be created. [ 1121.119201] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.121184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.121184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.121184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.121184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.131353] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: UNINITIALIZED for 2s [ 1121.164055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.164055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.164055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.164055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.164055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.164055] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1121.195540] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.195540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.195754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.195787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.195938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.205722] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1121.478353] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1121.478572] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.478745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.479139] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.479452] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.479603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.479672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.479828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.479934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.480048] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.779778] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1121.780033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.780577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.780764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.781766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.781766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.781766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.781766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.781766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.781766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.781766] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.983675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.983675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.983675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.983675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.983675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.984120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.984120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.984120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.984305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.984305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.984402] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1122.022067] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.022067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.022067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.022067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.022067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.037578] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1122.134353] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c69e6e7-74ae-42af-b87e-48cbcee6ac27 req-d1cabc04-209a-4a2c-92d3-7b927da71ad1 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1122.134728] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1122.135336] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.135438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.135438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.135898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.136094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.137329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.137329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.137329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.137329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.141960] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.289550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.289550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.289550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.289550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.289550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.290312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.290312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.290312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.290312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.290312] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.551011] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-847 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.551230] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.551355] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.551616] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.551875] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.552069] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.552230] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.552485] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.552664] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.552916] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.553057] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.553171] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.553274] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.553384] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.553485] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.553613] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.578151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.578151] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.578151] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.578151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-847" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.578151] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-3417dceb-d114-4fbe-816e-13234112516f taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.578151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.578151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.578151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.578985] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3417dceb-d114-4fbe-816e-13234112516f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.648828] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.648828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.648828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.648828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.648828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.648828] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.649171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.649171] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.649447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.649585] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.649724] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 already deleted. [ 1122.649814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.794057] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1122.811913] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.812076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.812123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.812337] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.812426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.812636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.812731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.812798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.812951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.813034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.813209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.813299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.813360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.813496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.813568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.813749] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.813974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.814063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.814216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.814286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.814372] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1122.891572] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.891717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.891788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.891999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.892157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.904556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1123.083206] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.083825] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.083825] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.083931] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.084063] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.084325] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 3417dceb-d114-4fbe-816e-13234112516f not found, creating... [ 1123.084584] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.084782] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.085046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.085289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.085500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.087262] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.087262] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.087262] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.087262] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.087262] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.087262] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 3417dceb-d114-4fbe-816e-13234112516f is going to be created. [ 1123.133391] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.133603] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.133731] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.134016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.134259] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.134556] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.148951] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1123.149125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.149287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.149474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.149659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.149775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.149851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.149995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.150098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.150175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.150272] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.215085] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1123.215310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.652667] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.915429] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c69e6e7-74ae-42af-b87e-48cbcee6ac27 req-4c6fb647-d373-4e4b-807d-45073e7a8416 service nova] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1123.915933] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c69e6e7-74ae-42af-b87e-48cbcee6ac27 req-4c6fb647-d373-4e4b-807d-45073e7a8416 service nova] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1123.916364] env[65443]: INFO networking_nsxv3.common.synchronization [req-4c69e6e7-74ae-42af-b87e-48cbcee6ac27 req-4c6fb647-d373-4e4b-807d-45073e7a8416 service nova] Enqueued Resource ID: 3417dceb-d114-4fbe-816e-13234112516f with Priority: HIGHEST for action port [ 1123.917496] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_rules [ 1123.917979] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1123.917979] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3417dceb-d114-4fbe-816e-13234112516f with Priority: HIGHEST for action port [ 1123.918322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.918503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.918616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.918915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.919068] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.920526] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.920797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.920988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.921437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.921668] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.922289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.922289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.922289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.922483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.922747] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.923793] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-3417dceb-d114-4fbe-816e-13234112516f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.924012] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.924187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.924449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.924642] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3417dceb-d114-4fbe-816e-13234112516f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.051948] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1124.052605] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf deletion is rescheduled due to dependency. [ 1124.052605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.052605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.052849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.053047] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.053165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.053231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.053393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.053487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.053593] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.155652] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9d2da46-c29b-499a-9e47-3cf63308571e: rpc.has_security_group_logging(os_id): False [ 1124.182207] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.182475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.182623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.182966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.183151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.183537] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.183732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.183812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.184081] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.184228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.184367] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be created. [ 1124.256342] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.256442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.256442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.256649] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.256830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.269623] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1124.427203] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.427338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.427531] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.428435] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3417dceb-d114-4fbe-816e-13234112516f with status ACTIVE [ 1124.428847] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.428847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.428847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.429134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.429134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.429234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.429347] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.429412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.429559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.429634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.429839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.429889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.429966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.430484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.430636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.430682] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3417dceb-d114-4fbe-816e-13234112516f is going to be updated. [ 1124.475156] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.475156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.475156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.475361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.475392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.475721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3417dceb-d114-4fbe-816e-13234112516f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.557715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.557715] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.557715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.557715] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1124.606802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.606938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.606938] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.607163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.607348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.621689] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1124.919922] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1124.919922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.932382] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.950983] env[65443]: INFO networking_nsxv3.common.synchronization [req-d7dc1f24-de93-4b37-9e70-0173c0adb09b req-8a5cb7d3-153e-4e76-b6f7-db409406e259 tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1124.952261] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1124.952774] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.953025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.953134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.953764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.953965] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.954092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.954173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.955050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.955050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.955150] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.437060] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.437597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.437697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.438179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.438179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.438179] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 is going to be created. [ 1125.458962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.459193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.459251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.459570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.459728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.459981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.460119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.460192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.460379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.460488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.460658] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1125.468966] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.469180] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.469230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.469435] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.469596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.479182] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: UNINITIALIZED for 2s [ 1125.493527] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.493721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.493816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.494082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.494237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.507842] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1126.298534] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1126.300174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.634023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1126.634023] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf deletion is rescheduled due to dependency. [ 1126.634023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.866793] env[65443]: INFO networking_nsxv3.common.synchronization [None req-5d03d0e9-d5b1-471a-a390-920527861638 None None] Enqueued Resource ID: 140cde98-308e-417b-98ca-b993f93dc1d0 with Priority: HIGHEST for action port [ 1126.867513] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 140cde98-308e-417b-98ca-b993f93dc1d0 with Priority: HIGHEST for action port [ 1126.867824] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-140cde98-308e-417b-98ca-b993f93dc1d0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.867948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-140cde98-308e-417b-98ca-b993f93dc1d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.868301] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-140cde98-308e-417b-98ca-b993f93dc1d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.868477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-140cde98-308e-417b-98ca-b993f93dc1d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.868561] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('140cde98-308e-417b-98ca-b993f93dc1d0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.371225] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 140cde98-308e-417b-98ca-b993f93dc1d0 [ 1127.371556] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.371930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.371930] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.372087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.372182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.372286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:140cde98-308e-417b-98ca-b993f93dc1d0 already deleted. [ 1127.372558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-140cde98-308e-417b-98ca-b993f93dc1d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.489697] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: SUCCESS [ 1127.489928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.490770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.490770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.490770] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.490770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.490770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.490770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.491068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.491068] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.491068] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.518289] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1127.518458] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e deletion is rescheduled due to dependency. [ 1127.518583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.993771] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.496504] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79e0e43b-4683-4690-b35f-e325fdce8e11: rpc.has_security_group_logging(os_id): False [ 1128.519220] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.519220] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.519220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.519220] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 is going to be created. [ 1128.580529] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.580725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.580725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.580913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.581174] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.594821] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: IN_PROGRESS for 2s [ 1129.078569] env[65443]: INFO networking_nsxv3.common.synchronization [None req-825a29b0-716b-4871-98eb-60e34609c7a0 None None] Enqueued Resource ID: 8a04aec1-37d2-44a7-abdb-4bf17114e3bf with Priority: HIGHEST for action port [ 1129.079193] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a04aec1-37d2-44a7-abdb-4bf17114e3bf with Priority: HIGHEST for action port [ 1129.079484] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a04aec1-37d2-44a7-abdb-4bf17114e3bf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.079601] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a04aec1-37d2-44a7-abdb-4bf17114e3bf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.079666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a04aec1-37d2-44a7-abdb-4bf17114e3bf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.079928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a04aec1-37d2-44a7-abdb-4bf17114e3bf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.081735] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a04aec1-37d2-44a7-abdb-4bf17114e3bf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.557985] env[65443]: INFO networking_nsxv3.common.synchronization [req-40a8873f-a34b-4f25-8e06-ea4c7d0d04a0 req-bb02c33e-075c-4d6f-8970-b7e889f51c86 tempest-ServersTestJSON-1621483577 tempest-ServersTestJSON-1621483577-project-member] Enqueued Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1129.562124] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08bead38-748c-49c3-9386-219294620db2 with Priority: HIGHEST for action security_group_members [ 1129.563176] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-08bead38-748c-49c3-9386-219294620db2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.563351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.563453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.563592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.563748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.563847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.563919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.564090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.564177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.564288] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('08bead38-748c-49c3-9386-219294620db2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.586187] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a04aec1-37d2-44a7-abdb-4bf17114e3bf [ 1129.586415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.586571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.586617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.586861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.586955] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.587207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a04aec1-37d2-44a7-abdb-4bf17114e3bf already deleted. [ 1129.587324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a04aec1-37d2-44a7-abdb-4bf17114e3bf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.067031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.067031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.067031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.067416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.067416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.067416] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.067538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.067538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.067684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.067757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.067840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 is going to be updated. [ 1130.096570] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.096764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.096764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.096970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.097126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.105474] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: IN_PROGRESS for 2s [ 1130.606969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: SUCCESS [ 1130.607280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.119524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 08bead38-748c-49c3-9386-219294620db2 in Status: SUCCESS [ 1132.119964] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 08bead38-748c-49c3-9386-219294620db2 deletion is rescheduled due to dependency. [ 1132.119964] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-08bead38-748c-49c3-9386-219294620db2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.816397] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-14c55abb-fac5-4110-8b5a-ea18433d0a5e tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1132.816969] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1132.817533] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.817709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.817816] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.818112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.818381] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.818546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.818618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.818885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.819164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.819259] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.135306] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-41b80c4b-e6eb-4481-9036-67dee0b26117 tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1133.136075] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1133.136274] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.136443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.322120] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.322313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.322402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.322624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.322740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.322962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.323085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.323145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.323300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.323393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.323498] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1133.349121] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.349325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.349365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.349579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.349727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.359555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1133.513634] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-779 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.513889] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-779" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.514011] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-779" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.514459] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-779" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.514748] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.514912] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.515106] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.515381] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.515494] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.515702] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.515812] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1133.515920] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1133.516059] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1133.516176] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1133.516281] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1133.516410] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1133.537314] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1133.537506] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1133.537703] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1133.537901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-779" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.538503] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-d26eb648-d7cd-4343-ae35-60e77a6722fa taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.538503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.538704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.538975] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.541043] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26eb648-d7cd-4343-ae35-60e77a6722fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.042226] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.042734] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.042734] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.042861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.043055] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.043361] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port d26eb648-d7cd-4343-ae35-60e77a6722fa not found, creating... [ 1134.043478] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.043633] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.043757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.043961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.044118] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.044406] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.044557] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.044671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.044878] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.045052] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.045203] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: d26eb648-d7cd-4343-ae35-60e77a6722fa is going to be created. [ 1134.067314] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.067598] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.067726] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.068049] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.068291] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.068596] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.838153] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-1398f195-41a1-4e90-8f33-88f886037e72 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1134.838481] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-1398f195-41a1-4e90-8f33-88f886037e72 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1134.838481] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-1398f195-41a1-4e90-8f33-88f886037e72 service nova] Enqueued Resource ID: d26eb648-d7cd-4343-ae35-60e77a6722fa with Priority: HIGHEST for action port [ 1134.839019] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1134.839158] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1134.839476] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d26eb648-d7cd-4343-ae35-60e77a6722fa with Priority: HIGHEST for action port [ 1134.839671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.839770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.839848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.840102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.840183] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.841402] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.841502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.841703] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-d26eb648-d7cd-4343-ae35-60e77a6722fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.841807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.841873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.842061] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.842140] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d26eb648-d7cd-4343-ae35-60e77a6722fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.236083] env[65443]: INFO networking_nsxv3.common.synchronization [req-3b7f9cba-4a03-4d6f-8d6e-a0490c72c82e req-112cc214-c6d8-4640-a272-808f282a8219 tempest-ServersNegativeTestJSON-346294223 tempest-ServersNegativeTestJSON-346294223-project-member] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1135.237014] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1135.237805] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.238414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.238414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.238414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.238414] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.238617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.238617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.238685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.239198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.239198] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.346265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.346396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.349045] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d26eb648-d7cd-4343-ae35-60e77a6722fa with status ACTIVE [ 1135.349045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.349242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.349242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.349364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.349445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.349625] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.349722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.349783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.349931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.350020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.350200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.350289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.350343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.350476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.350549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.350631] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d26eb648-d7cd-4343-ae35-60e77a6722fa is going to be updated. [ 1135.370662] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1135.370830] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf deletion is rescheduled due to dependency. [ 1135.370954] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.371175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.371463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.371674] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.371813] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.371882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.372072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.372194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.372273] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.376874] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.376874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.376874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.376874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.376874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.376874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d26eb648-d7cd-4343-ae35-60e77a6722fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.672649] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.673212] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.673212] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.673415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.673710] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.673853] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.673964] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.674201] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.674344] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.674631] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.674862] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.674862] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.675048] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.675187] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.675327] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.675517] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.699936] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.700203] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.700276] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.700455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.700785] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a9f8068d-1de8-4e4e-9a29-61b474adf683 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.701388] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.701545] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.701884] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.702061] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f8068d-1de8-4e4e-9a29-61b474adf683',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.707784] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-428 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.708398] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-428" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.708398] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-428" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.708874] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-428" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.709953] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.709953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.709953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.709953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.710209] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.710307] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.710421] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1135.710553] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1135.710683] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1135.710772] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1135.710873] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1135.711018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1135.736236] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1135.736525] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1135.736607] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1135.736990] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-428" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.737497] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-942c39d3-7317-400f-b52f-45a156350d36 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.737777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.737888] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.738482] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.738708] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942c39d3-7317-400f-b52f-45a156350d36',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.740896] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.741123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.741310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.741514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.741605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.741804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.741903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.741967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.742189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.742333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.742333] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 already deleted. [ 1135.742480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.875792] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.213645] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.214056] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.214366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.215581] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.215581] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.215581] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a9f8068d-1de8-4e4e-9a29-61b474adf683 not found, creating... [ 1136.215581] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.215803] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.215803] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.215948] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.216102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.216459] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.216620] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.216733] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.216943] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.217114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.217260] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 is going to be created. [ 1136.237417] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.237624] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.237739] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.238075] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.238244] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.238467] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.241283] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.241466] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.241615] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.242060] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.242276] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.242474] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 942c39d3-7317-400f-b52f-45a156350d36 not found, creating... [ 1136.242870] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.243136] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.243358] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.243693] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.243906] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.244312] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.244477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.244592] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.244811] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.245057] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.245185] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 942c39d3-7317-400f-b52f-45a156350d36 is going to be created. [ 1136.267589] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.267886] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.267970] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.268306] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.268547] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.268776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.378686] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.881768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.882293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.882293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.882502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.882640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.882719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1136.913242] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.913432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.913517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.913869] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.914096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.924642] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1136.955533] env[65443]: INFO networking_nsxv3.common.synchronization [req-3b7f9cba-4a03-4d6f-8d6e-a0490c72c82e req-33c00001-3b56-498c-8b60-e132f56f05a6 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1136.955750] env[65443]: INFO networking_nsxv3.common.synchronization [req-3b7f9cba-4a03-4d6f-8d6e-a0490c72c82e req-33c00001-3b56-498c-8b60-e132f56f05a6 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1136.955886] env[65443]: INFO networking_nsxv3.common.synchronization [req-3b7f9cba-4a03-4d6f-8d6e-a0490c72c82e req-33c00001-3b56-498c-8b60-e132f56f05a6 service nova] Enqueued Resource ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 with Priority: HIGHEST for action port [ 1136.956464] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1136.956606] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1136.956704] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 with Priority: HIGHEST for action port [ 1136.956968] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.957100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.957167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.957754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.957851] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.958783] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.958891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.958994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.959197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.959908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.959908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.959908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.959908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.959908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.959908] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.963364] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f8068d-1de8-4e4e-9a29-61b474adf683 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.963364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.963503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.963533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.964123] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f8068d-1de8-4e4e-9a29-61b474adf683',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.990567] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-c6892583-a2f0-4060-a270-536c40032348 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1136.990781] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-c6892583-a2f0-4060-a270-536c40032348 service nova] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1136.990950] env[65443]: INFO networking_nsxv3.common.synchronization [req-07fdd0c4-9efe-49f0-bf2e-0589007f9cd5 req-c6892583-a2f0-4060-a270-536c40032348 service nova] Enqueued Resource ID: 942c39d3-7317-400f-b52f-45a156350d36 with Priority: HIGHEST for action port [ 1136.991455] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_rules [ 1136.991592] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1136.991690] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 942c39d3-7317-400f-b52f-45a156350d36 with Priority: HIGHEST for action port [ 1136.992200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.992328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.992495] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.992622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.992741] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-942c39d3-7317-400f-b52f-45a156350d36 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.992838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.992927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.993152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.993234] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('942c39d3-7317-400f-b52f-45a156350d36',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.465381] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.466941] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.467160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.468861] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9f8068d-1de8-4e4e-9a29-61b474adf683 with status ACTIVE [ 1137.469202] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.469404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.469566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.469854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.470072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.470375] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.470550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.470678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.470949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.471120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.471532] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.471615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.471728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.471988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.472172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.472500] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 is going to be updated. [ 1137.495466] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 942c39d3-7317-400f-b52f-45a156350d36 with status ACTIVE [ 1137.495709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.495883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.495998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.496327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.496480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.496689] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.496793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.496859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.497154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.497245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.497425] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.497510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.497592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.497717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.498361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.498585] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 942c39d3-7317-400f-b52f-45a156350d36 is going to be updated. [ 1137.501717] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.501863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.501939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.502147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.502279] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.502438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.527483] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.527688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.527773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.527921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.529365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.529365] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-942c39d3-7317-400f-b52f-45a156350d36" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.733583] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcc98a11-6ee6-4eae-b184-10a8fce6dde3 req-75ae4ec7-9dc2-42fa-9039-2cbf9594f897 tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1137.734351] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1137.734761] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.734898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.734976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.735231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.735399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.735493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.735546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.735754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.735918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.736116] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.970027] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.065026] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.065026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.065026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.065026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.065319] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.065457] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.065638] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.065750] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.065924] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.066243] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.066382] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.066537] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.066681] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.066832] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.067160] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.067246] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.091488] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.091756] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.092516] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.092516] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.092516] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-aa4ac103-6c66-4516-940a-a0cf2f3d2410 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.092516] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.092702] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.093159] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.093359] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4ac103-6c66-4516-940a-a0cf2f3d2410',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.239779] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.239779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.239779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.239779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.240096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.240261] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.240261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.240429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.240482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.240617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.240736] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1138.272155] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.272155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.272392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.272392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.272525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.284957] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1138.471772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.471961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.472058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.472346] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.472444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.472577] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be created. [ 1138.500421] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.500750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.500842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.501127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.501338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.511885] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: UNINITIALIZED for 2s [ 1138.596446] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.596705] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.596792] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.597093] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.597797] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.597797] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port aa4ac103-6c66-4516-940a-a0cf2f3d2410 not found, creating... [ 1138.597797] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.597946] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.598072] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.598296] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.598432] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.598712] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.598865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.598979] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.599238] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.599372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.599511] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 is going to be created. [ 1138.621046] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.621244] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.621373] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.621672] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.621904] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.622152] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.934472] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1138.934694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.934854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.935121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.935311] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.935462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.935521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.935650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.935732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.935826] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.306201] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcc98a11-6ee6-4eae-b184-10a8fce6dde3 req-4032ee0e-8d76-42c2-8bb4-76dd1db64ef1 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1139.306201] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcc98a11-6ee6-4eae-b184-10a8fce6dde3 req-4032ee0e-8d76-42c2-8bb4-76dd1db64ef1 service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1139.306530] env[65443]: INFO networking_nsxv3.common.synchronization [req-fcc98a11-6ee6-4eae-b184-10a8fce6dde3 req-4032ee0e-8d76-42c2-8bb4-76dd1db64ef1 service nova] Enqueued Resource ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 with Priority: HIGHEST for action port [ 1139.306861] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1139.306995] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1139.307664] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 with Priority: HIGHEST for action port [ 1139.308032] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.308192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.308286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.308514] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.308630] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.309845] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.309982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.310278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4ac103-6c66-4516-940a-a0cf2f3d2410 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.310474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.310571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.310786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.310906] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4ac103-6c66-4516-940a-a0cf2f3d2410',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.437773] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.813374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.813501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.813670] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4ac103-6c66-4516-940a-a0cf2f3d2410 with status ACTIVE [ 1139.813755] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.813937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.813997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.814187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.814305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.814450] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.814557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.814611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.814740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.814811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.814984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.815140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.815194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.815312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.815381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.815464] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 is going to be updated. [ 1139.839705] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.839705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.839705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.839705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.840134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.840134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.940893] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.294930] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1140.295888] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e deletion is rescheduled due to dependency. [ 1140.295888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.295888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.296186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.296226] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.296342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.296409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.296594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.296675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.296775] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.444157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.444157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.444157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.444526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.444526] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.444616] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1140.484026] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.484229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.484229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.484442] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.484918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.496770] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1140.521415] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1140.521648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.522253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.522492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.522693] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.522872] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.522942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.523145] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.523263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.523402] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.523454] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.799394] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.026580] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.026752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.026848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.027111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.027475] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.027475] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.030107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.031103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.031103] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.031388] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.031388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.031388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.031596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.031596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.031656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.031738] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.302083] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.536258] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf65220-606f-4a01-8e7d-91599d70c077: rpc.has_security_group_logging(os_id): False [ 1141.556075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.556242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.556325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.556569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.556720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.557209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.557209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.557404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.557404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.557472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.558054] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.558054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.558054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.558054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.558281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.558342] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.558437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.558503] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.558638] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.558721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.558806] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be created. [ 1141.635496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.635706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.635758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.635947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.636350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.650951] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1141.805281] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.806247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.806395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.806742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.807448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.807448] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1141.839907] env[65443]: INFO networking_nsxv3.common.synchronization [req-e8790488-d35c-4370-9078-61b177515bfb req-86917702-64a6-4222-a3b7-8aaa3f3af751 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1141.840502] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1141.840809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.840927] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.840996] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.841447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.841623] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.841732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.841799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.841986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.842059] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.842141] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.844151] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.844260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.844325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.844484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.845687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.855686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1142.251571] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.251790] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.251987] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.255082] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.255082] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.259597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.259597] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.260124] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.260416] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.260786] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.260942] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.261123] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.261244] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.261456] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.261660] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.261882] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.300459] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.300702] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.302302] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.302302] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.303467] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.304088] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.304326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.304757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.304907] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b73f41-10de-44e3-a845-6cb17dcb2a7d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.346741] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.507495] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1142.508034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.510018] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.510018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.510018] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.510760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.511058] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.511343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.511564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.511744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.513427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.513427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.513427] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.809634] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.810676] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.810837] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.811168] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.811323] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.811479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port e2b73f41-10de-44e3-a845-6cb17dcb2a7d not found, creating... [ 1142.811767] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.811979] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.813270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.813270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.813270] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.813270] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.813522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.813522] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.813694] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.813836] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.814031] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: e2b73f41-10de-44e3-a845-6cb17dcb2a7d is going to be created. [ 1142.841558] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.841558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.841558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.841558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.841558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.841558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.851145] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.014690] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.015791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.015791] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.353410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.353530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.353711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.354315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.354315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.354315] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be updated. [ 1143.394496] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.395095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.395457] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.395821] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.396377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.409504] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1143.518588] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.576798] env[65443]: INFO networking_nsxv3.common.synchronization [req-e8790488-d35c-4370-9078-61b177515bfb req-7a61e612-67d8-4c6e-b2e3-b3eb286ddd23 service nova] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1143.576945] env[65443]: INFO networking_nsxv3.common.synchronization [req-e8790488-d35c-4370-9078-61b177515bfb req-7a61e612-67d8-4c6e-b2e3-b3eb286ddd23 service nova] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1143.577098] env[65443]: INFO networking_nsxv3.common.synchronization [req-e8790488-d35c-4370-9078-61b177515bfb req-7a61e612-67d8-4c6e-b2e3-b3eb286ddd23 service nova] Enqueued Resource ID: e2b73f41-10de-44e3-a845-6cb17dcb2a7d with Priority: HIGHEST for action port [ 1143.577651] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_rules [ 1143.577783] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1143.577877] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b73f41-10de-44e3-a845-6cb17dcb2a7d with Priority: HIGHEST for action port [ 1143.578492] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.578618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.578747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.578929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.579278] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.580217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.580309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.580503] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.580589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.580653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.580818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.580893] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b73f41-10de-44e3-a845-6cb17dcb2a7d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.663092] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1143.663318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.867079] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1143.867575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.867575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.867767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.867832] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.867931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.867989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.868157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.868242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.868313] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.868402] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.020719] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.020886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.020963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.021232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.021327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.021527] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1144.055617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.055827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.055878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.056122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.056289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.067169] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1144.082822] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.083113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.083375] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b73f41-10de-44e3-a845-6cb17dcb2a7d with status ACTIVE [ 1144.083603] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.083759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.083856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.084172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.084303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.084531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.084729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.084729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.084922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.085090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.085359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.085476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.085544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.085717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.085802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.085907] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b73f41-10de-44e3-a845-6cb17dcb2a7d is going to be updated. [ 1144.114216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.114418] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.114499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.114734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.114876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.115157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b73f41-10de-44e3-a845-6cb17dcb2a7d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.370925] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.873913] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 1144.893109] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.893333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.893333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.893815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.893815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.894078] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.894269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.894374] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.894554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.894622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.894734] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1144.966621] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.966854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.966902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.967154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.967340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.982356] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1145.422206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1145.422450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.422686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.423069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.423296] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.423419] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.423488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.423650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.423731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.423825] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.926685] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.079640] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1146.079972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.080524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.080825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.081106] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.081276] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.081356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.081550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.081652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.081807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.082061] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.082186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.082264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.082397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.082613] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.082613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.082725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.082805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.082876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.082956] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.083059] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.429208] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.585430] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57265bd0-8115-40d5-9d60-a57a4b18bbaf: rpc.has_security_group_logging(os_id): False [ 1146.603528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.603666] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.603736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.603942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.604044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.604234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.604330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.604392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.604535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.604610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.604786] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.604876] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.604935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.605122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.605202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.605399] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.605501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.605552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.605686] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.605757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.605841] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1146.665534] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.665702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.665775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.665976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.666162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.683023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1146.931398] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.931719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.931719] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.931830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.931915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.932024] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be updated. [ 1146.963158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.963289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.963351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.963548] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.963683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.976535] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1146.994803] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1146.994803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.578680] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1148.578987] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1148.701405] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1148.701636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.701826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.702123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.702268] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.986710] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1148.986908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.987175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.987414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.987590] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.987705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.987779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.987921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.987999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.988094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.988186] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.204857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.205123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.205217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.205561] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.205811] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.205963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.206090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.206306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.206493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.206556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.206670] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.490756] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.708585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.708917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.708917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.709187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.709372] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.709479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.709543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.709698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.709784] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.709873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.710033] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.710133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.710197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.710340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.710472] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.710573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.710632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.710766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.710841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.710921] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.711051] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.993128] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b9d2da46-c29b-499a-9e47-3cf63308571e: rpc.has_security_group_logging(os_id): False [ 1150.013122] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.013286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.013351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.013575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.013664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.013905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.014010] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.014075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.014250] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.014364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.014461] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be updated. [ 1150.073113] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.073314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.073368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.073573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.073720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.086719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1150.213126] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 57265bd0-8115-40d5-9d60-a57a4b18bbaf: rpc.has_security_group_logging(os_id): False [ 1150.234634] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.234776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.234847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.235101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.235186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.235415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.235529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.235529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.235693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.235770] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.236051] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.236149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.236187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.236327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.236403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.236605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.236702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.236755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.236887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.236947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.237048] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1150.335444] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.335602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.335655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.335848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.335991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.353965] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1150.710810] env[65443]: INFO networking_nsxv3.common.synchronization [req-fc06f23b-513a-4d21-941a-cdd08b1aa9c1 req-318ead1c-529e-4d4f-b718-be7593ad6a91 tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 1150.710810] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGHEST for action security_group_members [ 1150.710810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.710810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.710810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.710810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.710810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.710810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.710810] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.711459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.711459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.712065] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.862517] env[65443]: INFO networking_nsxv3.common.synchronization [req-ae4a80af-8e3f-4633-8a62-f190f9eeccc6 req-441b9a16-dd92-436f-aa25-d91d5ce3d9be tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1150.863366] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1150.863766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.863870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.863870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.864071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.864278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.864401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.864481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.864671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.865472] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.865472] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.119817] env[65443]: INFO networking_nsxv3.common.synchronization [req-ae4a80af-8e3f-4633-8a62-f190f9eeccc6 req-468b57e1-580d-487f-87ed-caf622945056 tempest-ServersTestMultiNic-578469896 tempest-ServersTestMultiNic-578469896-project-member] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1151.122100] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGHEST for action security_group_members [ 1151.122607] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.122742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.216040] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.216462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.216462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.216621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.216737] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.216942] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.217162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.217226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.217381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.217454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.217552] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be updated. [ 1151.247962] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.248280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.248280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.248412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.248528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.259503] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: IN_PROGRESS for 2s [ 1151.370079] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.723278] env[65443]: INFO networking_nsxv3.common.synchronization [req-f1f3d0fe-cb6b-468d-ac8d-9bab502646b9 req-7654cc24-b1c2-44e8-b6bf-078782bccb51 tempest-ServersNegativeTestJSON-346294223 tempest-ServersNegativeTestJSON-346294223-project-member] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1151.723754] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1151.724627] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.725479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.725592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.726025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.726541] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.726700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.726794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.727024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.727593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.727754] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.872232] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.049934] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.050161] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.050291] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.050554] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.050812] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.050960] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.051088] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.051299] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.051443] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.051668] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.051781] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.051887] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.051994] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.052114] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.052217] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.052358] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.076512] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.076682] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.076815] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.076987] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.077345] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-42597ee2-0b1e-4a68-b8f7-8764e6724705 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.077602] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.077720] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.078052] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.078196] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42597ee2-0b1e-4a68-b8f7-8764e6724705',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.101051] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1152.101324] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.230136] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.371580] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1152.371580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.376555] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.376555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.376555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.376555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.376555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.376555] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1152.403799] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.403799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.403799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.403799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.403799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.412886] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1152.581075] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.581456] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.581671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.582102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.582354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.582609] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 42597ee2-0b1e-4a68-b8f7-8764e6724705 not found, creating... [ 1152.583053] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.583326] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.583533] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.583897] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.584158] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.584640] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.584899] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.585121] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.585436] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.585674] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.585873] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 42597ee2-0b1e-4a68-b8f7-8764e6724705 is going to be created. [ 1152.625234] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.625542] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.625636] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.625902] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.626220] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.626482] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.733335] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.236433] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.236650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.236650] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.236919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.236975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.237059] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1153.273282] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0497189d-9410-4586-bc37-f5d3774f6c57 in Status: SUCCESS [ 1153.273679] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 deletion is rescheduled due to dependency. [ 1153.274033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.287131] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.287131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.287131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.287699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.287699] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.298739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1153.365622] env[65443]: INFO networking_nsxv3.common.synchronization [req-f1f3d0fe-cb6b-468d-ac8d-9bab502646b9 req-34f8e8ce-de47-4663-affa-8a34370136f5 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1153.365805] env[65443]: INFO networking_nsxv3.common.synchronization [req-f1f3d0fe-cb6b-468d-ac8d-9bab502646b9 req-34f8e8ce-de47-4663-affa-8a34370136f5 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1153.365941] env[65443]: INFO networking_nsxv3.common.synchronization [req-f1f3d0fe-cb6b-468d-ac8d-9bab502646b9 req-34f8e8ce-de47-4663-affa-8a34370136f5 service nova] Enqueued Resource ID: 42597ee2-0b1e-4a68-b8f7-8764e6724705 with Priority: HIGHEST for action port [ 1153.366544] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1153.366692] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1153.366803] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42597ee2-0b1e-4a68-b8f7-8764e6724705 with Priority: HIGHEST for action port [ 1153.370480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.370480] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.370480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.370480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-42597ee2-0b1e-4a68-b8f7-8764e6724705 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.370480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.370480] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42597ee2-0b1e-4a68-b8f7-8764e6724705',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.664018] env[65443]: INFO networking_nsxv3.common.synchronization [None req-e14e20b4-3dc5-4b03-8532-768b075bd5e8 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1153.664693] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1153.665029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.666030] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.666030] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.666368] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.871911] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.872215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.875498] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42597ee2-0b1e-4a68-b8f7-8764e6724705 with status ACTIVE [ 1153.875694] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.875858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.875933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.876208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.876334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.876525] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.876657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.876687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.876866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.876985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.877151] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.877263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.877336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.877555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.877675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.877715] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42597ee2-0b1e-4a68-b8f7-8764e6724705 is going to be updated. [ 1153.904181] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.904382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.904480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.904677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.904812] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.904969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42597ee2-0b1e-4a68-b8f7-8764e6724705" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.169295] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.169295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.169295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.169295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.169295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.169559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.169607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.169639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.169775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.169857] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.169947] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1154.197063] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.197199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.197199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.197848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.197848] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.208679] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1154.424917] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1154.424917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.424917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.425110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.425345] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.425482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.425550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.425711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.425793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.425894] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.527390] env[65443]: INFO networking_nsxv3.common.synchronization [req-a71c897b-744f-40f4-bf35-ed1199c1449e req-8c34db87-a09d-431e-91d2-dfb8cc41c3a3 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1154.527987] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1154.528391] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.528478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.528528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.530543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.530543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.530543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.530543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.530543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.530543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.530543] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.929382] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.929852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.929852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.930213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.932451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.932949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.932949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.932949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.933208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.933208] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.933288] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be updated. [ 1154.961717] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.962701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.962701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.962701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.962701] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.972362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: IN_PROGRESS for 2s [ 1155.035029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.035029] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.035029] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.035029] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1155.087591] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.087591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.087591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.087591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.087591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.096639] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1155.310318] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1155.310628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.310832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.311149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.311435] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.311610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.311718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.311941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.312079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.312226] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.814856] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.220579] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 4s [ 1156.317334] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.452273] env[65443]: INFO networking_nsxv3.common.synchronization [None req-bfb947c7-cd2f-45aa-a2f9-5d0152e9b948 tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1156.452836] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1156.453219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.453295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.453377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.453604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.453727] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.530682] env[65443]: INFO networking_nsxv3.common.synchronization [None req-d6941984-9901-4734-ae4a-0b1ae50d9f4e tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1156.531206] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1156.532095] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.532203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.820262] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.820626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.820626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.820789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.820789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.820900] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1156.850199] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.850379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.850425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.850609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.850751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.861261] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1156.974107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.974264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.974326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.974531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.974619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.974719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 already deleted. [ 1156.974804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.975990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.976206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.976335] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.983808] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf in Status: SUCCESS [ 1156.983975] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf deletion is rescheduled due to dependency. [ 1156.984089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.107237] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1157.107531] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1157.107655] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.498851] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.499181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.499181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.499560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.499706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.499811] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 already deleted. [ 1157.499903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.231404] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1158.231619] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 deletion is rescheduled due to dependency. [ 1158.231754] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.872766] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1158.873202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.873202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.873466] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.873661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.873790] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.873867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.874125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.874125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.874219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.874293] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.378123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.378123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.378123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.378123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.378123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.378123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.378123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.378582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.378582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.378582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.378582] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.378723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.378723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.378885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.379045] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.379137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.379197] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.379342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.379420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.379497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.379585] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.882017] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf65220-606f-4a01-8e7d-91599d70c077: rpc.has_security_group_logging(os_id): False [ 1159.901072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.901072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.901072] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.901320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.901356] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.901571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.901671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.901732] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.901879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.901976] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.902175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.902288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.902361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.902502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.902577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.902766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.902871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.902962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.903200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.903292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.903402] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1159.963844] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.963985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.964066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.964455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.964621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.978980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1161.532448] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1161.532798] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1161.993946] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1161.994206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.096975] env[65443]: INFO networking_nsxv3.common.synchronization [req-54f130f9-6452-42fe-a5ca-a7616d639694 req-f460e80c-9c7c-4c98-a052-18e0945317af tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1162.097524] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1162.097804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.097923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.097998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.098251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.098402] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.098500] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.098560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.098705] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.098788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.098879] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.389475] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.389475] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.389475] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.389475] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.389722] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.389844] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.390041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.390307] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.390488] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.390734] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.390851] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1162.390971] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1162.391095] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1162.391215] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1162.391323] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1162.391469] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1162.412292] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1162.412487] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1162.412962] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1162.412962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.414461] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-46132112-93de-44ee-8f40-cd3bb6d16fd5 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.414461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.414461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.414461] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.414461] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46132112-93de-44ee-8f40-cd3bb6d16fd5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.577247] env[65443]: INFO networking_nsxv3.common.synchronization [None req-b4ab71f2-514b-4023-bfbf-6dd37338147e None None] Enqueued Resource ID: 92069e45-028e-4a58-b895-99f4f75529b8 with Priority: HIGHEST for action port [ 1162.577247] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92069e45-028e-4a58-b895-99f4f75529b8 with Priority: HIGHEST for action port [ 1162.577247] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-92069e45-028e-4a58-b895-99f4f75529b8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.577247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92069e45-028e-4a58-b895-99f4f75529b8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.577247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92069e45-028e-4a58-b895-99f4f75529b8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.577247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92069e45-028e-4a58-b895-99f4f75529b8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.577247] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92069e45-028e-4a58-b895-99f4f75529b8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.601520] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.601729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.601774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.601981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.602076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.602267] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.602373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.602414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.602565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.602642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.602744] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 already deleted. [ 1162.602801] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.917959] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.918206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.918339] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.918609] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.918778] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.918906] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 46132112-93de-44ee-8f40-cd3bb6d16fd5 not found, creating... [ 1162.919199] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.919383] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.919500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.919711] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.919839] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.920121] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.920273] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.920387] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.920671] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.920816] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.920949] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 is going to be created. [ 1162.964010] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.964218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.964378] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.964668] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.965036] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.965189] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.079108] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92069e45-028e-4a58-b895-99f4f75529b8 [ 1163.079357] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.079495] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.083254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.083254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.083254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.083254] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92069e45-028e-4a58-b895-99f4f75529b8 already deleted. [ 1163.083254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92069e45-028e-4a58-b895-99f4f75529b8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.331793] env[65443]: INFO networking_nsxv3.common.synchronization [None req-f837f3d3-439e-49e4-a3c4-9ead635a8feb tempest-ServerActionsV293TestJSON-1632459528 tempest-ServerActionsV293TestJSON-1632459528-project-member] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1163.332520] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1163.332520] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.332520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.333083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.333083] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.333083] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.454636] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0567cfed-7ff0-483a-a8f5-dde00131fb80 tempest-ServerActionsV293TestJSON-1632459528 tempest-ServerActionsV293TestJSON-1632459528-project-member] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1163.455255] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1163.455615] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.455839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.694798] env[65443]: INFO networking_nsxv3.common.synchronization [req-54f130f9-6452-42fe-a5ca-a7616d639694 req-2d2483e1-1be8-4ebb-89a0-bb48c2509321 service nova] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1163.695075] env[65443]: INFO networking_nsxv3.common.synchronization [req-54f130f9-6452-42fe-a5ca-a7616d639694 req-2d2483e1-1be8-4ebb-89a0-bb48c2509321 service nova] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1163.695149] env[65443]: INFO networking_nsxv3.common.synchronization [req-54f130f9-6452-42fe-a5ca-a7616d639694 req-2d2483e1-1be8-4ebb-89a0-bb48c2509321 service nova] Enqueued Resource ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 with Priority: HIGHEST for action port [ 1163.695718] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1163.696076] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1163.696076] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 with Priority: HIGHEST for action port [ 1163.696251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.696382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.696433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.696635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.696716] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.697920] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.697920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.697920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.697920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.698217] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.698217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.698217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.698370] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.698470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.698525] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.699287] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-46132112-93de-44ee-8f40-cd3bb6d16fd5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.699395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.699453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.699582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.699659] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46132112-93de-44ee-8f40-cd3bb6d16fd5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.853842] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.854037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.854084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.855119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.855119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.855119] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c already deleted. [ 1163.855119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.855119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.855555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.855555] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.201772] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.201918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.202106] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.203025] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46132112-93de-44ee-8f40-cd3bb6d16fd5 with status ACTIVE [ 1164.203237] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.204028] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.204028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.204371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.204371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.206252] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.206252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.206252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.206252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.206252] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.206252] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 is going to be updated. [ 1164.233257] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.233401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.233659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.233749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.233904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.234096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.378602] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.378602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.379907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.379907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.379907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.379907] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c already deleted. [ 1164.379907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.441416] env[65443]: INFO networking_nsxv3.common.synchronization [req-1c4e6513-4ae1-4cf2-8df0-4d294bdd7fab req-7037aefa-5cbd-41ee-969b-6a9fbc439b2c tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1164.441999] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1164.442385] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.442537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.442611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.442823] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.443011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.443131] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.443269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.443394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.443483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.443576] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.708160] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.785020] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.785250] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.785372] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.785624] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.785880] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.786622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.786622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.786622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.786622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.786904] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.786904] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1164.787048] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1164.787119] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1164.787227] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1164.787326] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1164.787454] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1164.806880] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1164.807057] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1164.807187] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1164.807367] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.807662] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-7b341b30-8f49-4202-b2ff-bc2fcaec081d taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.808034] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.808034] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.808294] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.808431] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b341b30-8f49-4202-b2ff-bc2fcaec081d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.946265] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.946468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.946568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.946859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.947020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.947301] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.947423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.947490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.947723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.947837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.947978] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1164.975809] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.976063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.976296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.976595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.976828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.986814] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1165.117663] env[65443]: INFO networking_nsxv3.common.synchronization [None req-4c511029-b463-43c1-b985-06b44adf7a19 None None] Enqueued Resource ID: 1b75c381-9884-43d0-a862-505a7234b922 with Priority: HIGHEST for action port [ 1165.118294] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b75c381-9884-43d0-a862-505a7234b922 with Priority: HIGHEST for action port [ 1165.118540] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b75c381-9884-43d0-a862-505a7234b922 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.118661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b75c381-9884-43d0-a862-505a7234b922" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.118740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b75c381-9884-43d0-a862-505a7234b922" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.118998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b75c381-9884-43d0-a862-505a7234b922" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.119128] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b75c381-9884-43d0-a862-505a7234b922',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.211437] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.211636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.211681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.211899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.211982] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.212106] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be created. [ 1165.240348] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.240348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.240348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.240635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.240797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.251169] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: UNINITIALIZED for 2s [ 1165.311499] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.311743] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.311855] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.312165] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.312320] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.312477] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 7b341b30-8f49-4202-b2ff-bc2fcaec081d not found, creating... [ 1165.312744] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.312904] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.313038] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.313408] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.313599] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.313902] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.314083] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.314204] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.314436] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.314571] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.314711] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 7b341b30-8f49-4202-b2ff-bc2fcaec081d is going to be created. [ 1165.337956] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.338180] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.338300] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.338568] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.338793] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.339018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.462957] env[65443]: INFO networking_nsxv3.common.synchronization [req-b97766f6-3ea0-46d9-ad88-bf3ba1ee516c req-12d1483b-175d-4903-9894-99c81574719a tempest-ServersNegativeTestJSON-346294223 tempest-ServersNegativeTestJSON-346294223-project-member] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1165.462957] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1165.463536] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.463536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.463682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.463752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.463907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.464050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.464142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.464317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.464407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.464504] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.620571] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b75c381-9884-43d0-a862-505a7234b922 [ 1165.620975] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.621211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.621353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.621685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.622728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.622728] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b75c381-9884-43d0-a862-505a7234b922 already deleted. [ 1165.622728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b75c381-9884-43d0-a862-505a7234b922" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.967665] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.048417] env[65443]: INFO networking_nsxv3.common.synchronization [req-1c4e6513-4ae1-4cf2-8df0-4d294bdd7fab req-23ef4b85-015e-48c8-bbac-dab3a86dae3d service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1166.048604] env[65443]: INFO networking_nsxv3.common.synchronization [req-1c4e6513-4ae1-4cf2-8df0-4d294bdd7fab req-23ef4b85-015e-48c8-bbac-dab3a86dae3d service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1166.048759] env[65443]: INFO networking_nsxv3.common.synchronization [req-1c4e6513-4ae1-4cf2-8df0-4d294bdd7fab req-23ef4b85-015e-48c8-bbac-dab3a86dae3d service nova] Enqueued Resource ID: 7b341b30-8f49-4202-b2ff-bc2fcaec081d with Priority: HIGHEST for action port [ 1166.049325] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1166.049478] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1166.049651] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b341b30-8f49-4202-b2ff-bc2fcaec081d with Priority: HIGHEST for action port [ 1166.049883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.050016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.050112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.050339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.050431] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.051310] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.051416] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.051612] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b341b30-8f49-4202-b2ff-bc2fcaec081d taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.051750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.051799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.051939] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.052029] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b341b30-8f49-4202-b2ff-bc2fcaec081d',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.470732] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.555073] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.555073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.555073] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7b341b30-8f49-4202-b2ff-bc2fcaec081d with status ACTIVE [ 1166.555073] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.555375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.555375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.555498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.555569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.555737] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.555832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.555977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.556055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.556130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.556316] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.556425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.556478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.556610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.556682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.556768] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7b341b30-8f49-4202-b2ff-bc2fcaec081d is going to be updated. [ 1166.578200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.578444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.578499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.578711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.578807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.579073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b341b30-8f49-4202-b2ff-bc2fcaec081d" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.973233] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.973747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.973747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.973933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.974080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.974190] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1166.999504] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1166.999742] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1166.999993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.000265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.000595] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.000959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.002009] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.002144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.002509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.002820] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.002981] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.014984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.014984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.014984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.014984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.014984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.030268] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1167.260731] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1167.260942] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.261123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.261342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.261530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.261651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.261718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.261871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.261953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.262051] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.262141] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.505895] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.764590] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.010168] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.266731] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0281fe2-9e20-4e23-b277-8c95ec2ef544: rpc.has_security_group_logging(os_id): False [ 1168.285163] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.285425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.285487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.285653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.285741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.286094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.286094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.286315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.286388] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.286464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.286551] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be created. [ 1168.350728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.350962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.350962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.351221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.351440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.362980] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: IN_PROGRESS for 2s [ 1168.512359] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.512359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.512359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.512756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.512756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.512756] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1168.544838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.544838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.544838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.544838] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.545270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.553491] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1169.040637] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1169.041142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.379166] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1170.379522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.563218] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1170.563517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.563691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.563905] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.564104] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.564222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.564285] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.564449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.564521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.564659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.564691] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.050436] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1171.050589] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1171.067194] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.067351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.067424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.067826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.068059] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.068136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.068202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.068381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.068520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.068670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.068837] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.068935] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.069023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.069153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.069291] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.069384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.069445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.069582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.069658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.069741] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.069832] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.572439] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1171.594458] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.594573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.594690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.595291] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.595405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.595641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.595760] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.595827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.596282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.596362] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.596562] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.596652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.596712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.596859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.596931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.597141] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.597237] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.597311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.597468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.597544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.597640] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1171.667943] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.667943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.667943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.667943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.667943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.682619] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1172.857909] env[65443]: INFO networking_nsxv3.common.synchronization [req-36bc0feb-fa27-46f8-80c6-ea296d5d5463 req-81e53f3f-17af-46ac-bc58-530ba050dce3 tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 1172.858296] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGHEST for action security_group_members [ 1172.858615] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.858734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.858803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.859119] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.859215] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.859299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.859299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.859443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.859524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.859622] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.362527] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.362527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.362825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.362825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.362898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.363113] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.363340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.363537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.363684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.363834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.363952] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac is going to be updated. [ 1173.390162] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.390378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.390378] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.390669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.390843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.399833] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: IN_PROGRESS for 2s [ 1173.697434] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1173.697679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.409306] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac in Status: SUCCESS [ 1175.409575] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac deletion is rescheduled due to dependency. [ 1175.409613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.517412] env[65443]: INFO networking_nsxv3.common.synchronization [None req-60e9af23-8663-4eaa-a4be-8840b679161a tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1177.517976] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1177.518312] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.518448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.518528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.518789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.518872] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.587493] env[65443]: INFO networking_nsxv3.common.synchronization [None req-59cb07f8-158b-4cfc-9869-b5c68bc4885f tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1177.588046] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1177.588341] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.588451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.041056] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.041056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.041056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.041360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.041360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.041424] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 already deleted. [ 1178.041460] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.041598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.041755] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.041848] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.562834] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.562834] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.563195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.563195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.563195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.563287] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 already deleted. [ 1178.563385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.750277] env[65443]: INFO networking_nsxv3.common.synchronization [req-39b84cd9-787e-4971-b731-0bf6e167597a req-4d60b068-fafa-4033-92be-a6ecd0b02b24 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1179.750277] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1179.750277] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.750277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.750277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.750277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.751346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.751640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.751809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.752067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.752261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.752446] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.254658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.254837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.254913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.255211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.255423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.255634] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.255753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.255817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.255981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.256076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.256164] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1180.298373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.298581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.298669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.298972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.299164] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.308202] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1182.319849] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1182.320116] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1182.320116] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.313407] env[65443]: INFO networking_nsxv3.common.synchronization [req-a3833b4b-1c19-4267-910e-842423bc63bb req-315d4b3e-7e17-45d9-93f7-add2b3da7532 tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1183.314032] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1183.314355] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.314476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.314544] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.314933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.315103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.315206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.315271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.315504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.315588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.315738] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.681445] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-190 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.681784] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.681836] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.682120] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.682373] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.682529] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.682643] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.682854] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.682996] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.683382] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.683501] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1183.683611] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1183.683715] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1183.683825] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1183.683927] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1183.684069] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1183.703281] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1183.703462] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1183.703579] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1183.703744] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-190" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.704068] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-0dd34a58-5494-4dd4-84b5-9444987b0631 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.704238] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.704357] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.704696] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.704834] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd34a58-5494-4dd4-84b5-9444987b0631',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.819175] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.819396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.819396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.819648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.819828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.819963] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.820089] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.820204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.820317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.820405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.820494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 already deleted. [ 1183.820576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.207477] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.207870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.207870] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.208074] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.208227] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.208383] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 0dd34a58-5494-4dd4-84b5-9444987b0631 not found, creating... [ 1184.208636] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.208791] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.208907] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.209156] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.209292] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.209566] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.209718] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.209832] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.210046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.210179] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.210316] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 0dd34a58-5494-4dd4-84b5-9444987b0631 is going to be created. [ 1184.232437] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.232703] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.232703] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.233016] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.233193] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.233422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.941431] env[65443]: INFO networking_nsxv3.common.synchronization [req-a3833b4b-1c19-4267-910e-842423bc63bb req-181d0428-37a7-475b-8016-9ab7712107e7 service nova] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1184.941764] env[65443]: INFO networking_nsxv3.common.synchronization [req-a3833b4b-1c19-4267-910e-842423bc63bb req-181d0428-37a7-475b-8016-9ab7712107e7 service nova] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1184.941764] env[65443]: INFO networking_nsxv3.common.synchronization [req-a3833b4b-1c19-4267-910e-842423bc63bb req-181d0428-37a7-475b-8016-9ab7712107e7 service nova] Enqueued Resource ID: 0dd34a58-5494-4dd4-84b5-9444987b0631 with Priority: HIGHEST for action port [ 1184.942266] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_rules [ 1184.942402] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1184.942499] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd34a58-5494-4dd4-84b5-9444987b0631 with Priority: HIGHEST for action port [ 1184.942764] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.942879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.942948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.943218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.943320] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.944541] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.944651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.944709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.945619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.945619] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.945619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.945619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.945619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.945619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.945619] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.946672] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dd34a58-5494-4dd4-84b5-9444987b0631 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.946672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.946672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.946672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.946672] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd34a58-5494-4dd4-84b5-9444987b0631',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.448522] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.448674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.448856] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.450041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0dd34a58-5494-4dd4-84b5-9444987b0631 with status ACTIVE [ 1185.450212] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.450404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.450404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.452558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.452558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.452558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.452558] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0dd34a58-5494-4dd4-84b5-9444987b0631 is going to be updated. [ 1185.475972] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.476453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.476642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.476973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.477321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.477597] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dd34a58-5494-4dd4-84b5-9444987b0631" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.953906] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.456605] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.456806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.456906] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.457215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.457320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.457440] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 is going to be created. [ 1186.483234] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.483395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.483395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.483694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.483806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.498788] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: UNINITIALIZED for 2s [ 1186.844238] env[65443]: INFO networking_nsxv3.common.synchronization [None req-3683c20b-5cc5-4e98-b2a0-0cf866ae2400 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1186.845141] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1186.845630] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.845773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.845975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.846309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.846501] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.922635] env[65443]: INFO networking_nsxv3.common.synchronization [None req-cb874f21-f35e-423f-ba32-4ceb6cbb3800 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1186.924532] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1186.924659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.924794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.367262] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.367549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.367549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.368212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.368212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.368212] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 already deleted. [ 1187.368371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.368451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.368664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.370650] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.444126] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.444303] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.444383] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.445045] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.445045] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.445246] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.445246] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.445477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.445623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.445824] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.445933] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1187.446051] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1187.446159] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1187.446271] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1187.446378] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1187.446508] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1187.467184] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1187.469183] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1187.469183] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1187.469183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.469183] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.469183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.469183] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.469542] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.469542] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd567ccb-1664-4fa9-b38e-3c0e24fb9765',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.895913] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.895913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.895913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.895913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.895913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.895913] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 already deleted. [ 1187.895913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.973041] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.973316] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.974041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.974041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.974041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.974186] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port cd567ccb-1664-4fa9-b38e-3c0e24fb9765 not found, creating... [ 1187.974477] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.974621] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.974737] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.974952] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.975104] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.975394] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.975563] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.975679] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.975886] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.976038] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.976181] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 is going to be created. [ 1188.000679] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.001025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.001162] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.001460] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.001707] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.001953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.277796] env[65443]: INFO networking_nsxv3.common.synchronization [req-8098abe5-078e-463e-8f34-eca76c4ac742 req-0c45e963-4aaa-41ec-b0e5-791917fbbfc8 tempest-ServerActionsV293TestJSON-1632459528 tempest-ServerActionsV293TestJSON-1632459528-project-member] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1188.277796] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1188.277796] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.278043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.278043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.278155] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.278319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.278415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.278647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.278647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.278727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.278781] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.510065] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: SUCCESS [ 1188.510339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.510499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.510726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.510939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.511096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.511161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.511328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.511413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.511520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.511628] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.641425] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-256 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.642151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-256" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.642151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-256" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.642151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-256" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.644207] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.644419] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.644550] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.644785] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.644935] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.645154] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.645267] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.645450] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.645565] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.645683] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.646216] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.646216] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.665725] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.665725] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.665725] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.666037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-256" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.666135] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-009a2ea9-294b-4c9a-b816-65b38570e848 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.666306] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.666493] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.666899] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.666996] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009a2ea9-294b-4c9a-b816-65b38570e848',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [req-d7afd98f-06a1-439b-ac75-3d4b3011f65b req-43939fab-6786-4857-a5bf-ca8225a101f1 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [req-d7afd98f-06a1-439b-ac75-3d4b3011f65b req-43939fab-6786-4857-a5bf-ca8225a101f1 service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [req-d7afd98f-06a1-439b-ac75-3d4b3011f65b req-43939fab-6786-4857-a5bf-ca8225a101f1 service nova] Enqueued Resource ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with Priority: HIGHEST for action port [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1188.726157] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with Priority: HIGHEST for action port [ 1188.726157] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.726157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.726157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.726157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.726157] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.727780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.727780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.727780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.727780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.727780] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.727780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.727780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.728112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.728112] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.728112] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.729728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.729728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.729728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.729728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.729728] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd567ccb-1664-4fa9-b38e-3c0e24fb9765',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.780774] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.780966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.780966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.781165] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.781240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.781435] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.781558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.781623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.781767] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.781841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.781926] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c already deleted. [ 1188.782016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.013876] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.169634] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.169896] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.170015] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.170309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.170484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.170680] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 009a2ea9-294b-4c9a-b816-65b38570e848 not found, creating... [ 1189.170950] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.171500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.171500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.171500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.171709] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.172015] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.172228] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.172348] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.172581] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.172717] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.172850] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 009a2ea9-294b-4c9a-b816-65b38570e848 is going to be created. [ 1189.196643] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.196918] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.196998] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.197330] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.197568] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.197869] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.231641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.231890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.232120] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.233645] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with status ACTIVE [ 1189.233645] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.234080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.234080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.234407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.234580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.234915] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.235124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.235232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.236050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.236050] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.236050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.236676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.236676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.236676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.236676] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.236676] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 is going to be updated. [ 1189.274984] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.275193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.275239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.275527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.275765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.275934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.516418] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e990d13f-064b-4b30-b919-33291fa4a9c6: rpc.has_security_group_logging(os_id): False [ 1189.536654] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.536890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.536890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.537100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.537192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.537531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.537639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.537776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.537947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.538041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.538132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 is going to be created. [ 1189.598654] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.598654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.598654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.599405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.599405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.614137] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: IN_PROGRESS for 2s [ 1189.739486] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.922505] env[65443]: INFO networking_nsxv3.common.synchronization [req-8098abe5-078e-463e-8f34-eca76c4ac742 req-709ddf48-074d-4bbd-90c7-3fc86edf80dc service nova] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1189.922702] env[65443]: INFO networking_nsxv3.common.synchronization [req-8098abe5-078e-463e-8f34-eca76c4ac742 req-709ddf48-074d-4bbd-90c7-3fc86edf80dc service nova] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1189.922886] env[65443]: INFO networking_nsxv3.common.synchronization [req-8098abe5-078e-463e-8f34-eca76c4ac742 req-709ddf48-074d-4bbd-90c7-3fc86edf80dc service nova] Enqueued Resource ID: 009a2ea9-294b-4c9a-b816-65b38570e848 with Priority: HIGHEST for action port [ 1189.923557] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_rules [ 1189.923757] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1189.923862] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 009a2ea9-294b-4c9a-b816-65b38570e848 with Priority: HIGHEST for action port [ 1189.924211] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.924349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.924434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.924614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.924732] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.925896] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.925896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.925984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.926138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.926288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.926411] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.926546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.926672] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.926764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.926888] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.929363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-009a2ea9-294b-4c9a-b816-65b38570e848 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.929363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.929363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.929363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.929363] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('009a2ea9-294b-4c9a-b816-65b38570e848',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.241855] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.242054] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.242257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.246144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.246315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.246494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1190.279166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.281040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.281040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.281040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.281040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.293018] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1190.429701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.429892] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.430224] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.431407] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 009a2ea9-294b-4c9a-b816-65b38570e848 with status ACTIVE [ 1190.431657] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.431825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.431871] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.432126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.432233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.432455] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.432553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.432591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.432749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.432868] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.433011] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.433108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.433226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.433326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.433482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.433524] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 009a2ea9-294b-4c9a-b816-65b38570e848 is going to be updated. [ 1190.460017] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.460230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.460230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.460433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.460570] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.460722] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-009a2ea9-294b-4c9a-b816-65b38570e848" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.577100] env[65443]: INFO networking_nsxv3.common.synchronization [req-15895028-c9fc-4b1e-88eb-d22fb6d7583b req-d3f49dff-d242-41e6-a17d-0fc0da581a58 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1190.577616] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1190.578481] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.578614] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.578687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.578888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.579077] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.579154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.579218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.579635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.579635] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.579635] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.930260] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.930569] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.930777] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.931151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.931507] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.931747] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.931950] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.932277] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.932500] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.932814] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.933096] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.933312] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.933493] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.933683] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.933858] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.934069] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.936148] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.960311] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.960311] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1190.960311] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.960311] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.960311] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-73fe152c-5af7-4522-ad50-a52a029a94d2 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.960555] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.960593] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.961071] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.961157] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fe152c-5af7-4522-ad50-a52a029a94d2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.082126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.082319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.082371] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.082653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.082811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.083070] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.083202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.083329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.083499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.083577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.083686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1191.111935] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.112196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.112321] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.112575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.112827] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.123151] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1191.439148] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.439427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.439427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.439626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.439730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.439851] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c is going to be created. [ 1191.463834] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.464101] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.464229] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.464550] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.464700] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.464854] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 73fe152c-5af7-4522-ad50-a52a029a94d2 not found, creating... [ 1191.465128] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.465297] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.465439] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.465692] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.465830] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.466184] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.466349] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.466490] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.466723] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.466871] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.467027] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 73fe152c-5af7-4522-ad50-a52a029a94d2 is going to be created. [ 1191.468931] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.469108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.469108] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.469258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.469410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.486307] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: UNINITIALIZED for 2s [ 1191.497271] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.497477] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.497596] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.497968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.498216] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.498441] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.628672] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: SUCCESS [ 1191.628944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.255948] env[65443]: INFO networking_nsxv3.common.synchronization [req-15895028-c9fc-4b1e-88eb-d22fb6d7583b req-86fbb425-1dfc-41ec-9c94-616c56e72866 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1192.256138] env[65443]: INFO networking_nsxv3.common.synchronization [req-15895028-c9fc-4b1e-88eb-d22fb6d7583b req-86fbb425-1dfc-41ec-9c94-616c56e72866 service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1192.256301] env[65443]: INFO networking_nsxv3.common.synchronization [req-15895028-c9fc-4b1e-88eb-d22fb6d7583b req-86fbb425-1dfc-41ec-9c94-616c56e72866 service nova] Enqueued Resource ID: 73fe152c-5af7-4522-ad50-a52a029a94d2 with Priority: HIGHEST for action port [ 1192.256997] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1192.257598] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1192.258288] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73fe152c-5af7-4522-ad50-a52a029a94d2 with Priority: HIGHEST for action port [ 1192.258725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.258909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.259056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.259310] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.259439] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.260760] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.261747] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.261857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-73fe152c-5af7-4522-ad50-a52a029a94d2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.261937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.261984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.262277] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.262381] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73fe152c-5af7-4522-ad50-a52a029a94d2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.310863] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1192.311070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.311222] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.311437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.311634] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.311751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.311817] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.311973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.312067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.312152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.312268] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.764721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.765044] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.770547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73fe152c-5af7-4522-ad50-a52a029a94d2 with status ACTIVE [ 1192.771659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.771659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.771659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.771659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.771659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.771659] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.772264] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.773908] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.773908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.775494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.775757] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73fe152c-5af7-4522-ad50-a52a029a94d2 is going to be updated. [ 1192.816031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.816271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.816320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.816578] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.816802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.816909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.816972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.817173] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.817244] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.818082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.818082] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.818082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.818082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.818082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.818082] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.818430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.818430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.818430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.818525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.818525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.819317] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.845879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.846147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.846147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.846373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.846575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.846768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73fe152c-5af7-4522-ad50-a52a029a94d2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.986664] env[65443]: INFO networking_nsxv3.common.synchronization [req-c589c8bc-8c56-4529-b90a-12462c66e2ea req-3942c5c2-2113-4a7b-b09f-fd784858b353 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1192.987306] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1192.987644] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.987968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.987968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.988122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.988276] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.988382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.988449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.988607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.988692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.988793] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.140840] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1193.141052] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1193.141138] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.141322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.141539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.141728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.141846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.141909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.142076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.142160] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.142271] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.321253] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e276458-6ae4-4b43-8889-3fac24210880: rpc.has_security_group_logging(os_id): False [ 1193.353671] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.353890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.353970] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.354206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.354323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.354559] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.354663] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.354730] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.354889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.354969] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.355169] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.355265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.355327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.355563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.355644] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.355834] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.355931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.355985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.356152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.356225] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.356315] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1193.394408] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.394613] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.394738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.395105] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.395448] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.395604] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.395741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.396067] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.396240] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.396519] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.396605] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.396722] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.396857] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.396975] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.397078] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.397334] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.421717] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.422028] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.422028] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.422400] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.423123] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-7a48f830-c1b3-4aed-99de-a896ac2206c8 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.423794] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.424380] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.424448] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.424637] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a48f830-c1b3-4aed-99de-a896ac2206c8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.451093] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.451093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.451093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.451093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.451093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.471567] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1193.492066] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.492066] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.492066] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 already deleted. [ 1193.492066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.502880] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: SUCCESS [ 1193.502880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.502880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.502880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.502880] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.502880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.503297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.503340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.504186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.504186] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.504186] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.645020] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.928343] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.928747] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.928747] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.929048] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.929230] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.929362] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port 7a48f830-c1b3-4aed-99de-a896ac2206c8 not found, creating... [ 1193.929634] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.929797] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.929929] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.930180] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.930317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.930637] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.930841] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.930908] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.931149] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.931284] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.931438] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: 7a48f830-c1b3-4aed-99de-a896ac2206c8 is going to be created. [ 1193.956240] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.956465] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.956653] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.957010] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.957230] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.957503] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.006560] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.149261] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.511724] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf8af7a1-ee42-4cc7-9906-f51878ad2a6c: rpc.has_security_group_logging(os_id): False [ 1194.532919] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.533142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.533142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.533443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.533557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.533825] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.533932] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.534043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.534192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.534273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.534367] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c is going to be created. [ 1194.609718] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.609897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.609975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.610281] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.610400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.628243] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: IN_PROGRESS for 2s [ 1194.652268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.652268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.652393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.653456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.653456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.653456] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1194.701969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.702251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.702251] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.702568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.702773] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.709602] env[65443]: INFO networking_nsxv3.common.synchronization [req-c589c8bc-8c56-4529-b90a-12462c66e2ea req-a59dba74-b43d-41cc-b5c3-4e8f3e5c584b service nova] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1194.709747] env[65443]: INFO networking_nsxv3.common.synchronization [req-c589c8bc-8c56-4529-b90a-12462c66e2ea req-a59dba74-b43d-41cc-b5c3-4e8f3e5c584b service nova] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1194.709876] env[65443]: INFO networking_nsxv3.common.synchronization [req-c589c8bc-8c56-4529-b90a-12462c66e2ea req-a59dba74-b43d-41cc-b5c3-4e8f3e5c584b service nova] Enqueued Resource ID: 7a48f830-c1b3-4aed-99de-a896ac2206c8 with Priority: HIGHEST for action port [ 1194.710455] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_rules [ 1194.710593] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1194.710692] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a48f830-c1b3-4aed-99de-a896ac2206c8 with Priority: HIGHEST for action port [ 1194.710969] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.711638] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.711715] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.711923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.712018] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.713401] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.713508] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.713577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.713752] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.713939] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.714043] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.714135] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.714221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.714302] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.714391] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.715685] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a48f830-c1b3-4aed-99de-a896ac2206c8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.715685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.715685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.715685] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.715979] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a48f830-c1b3-4aed-99de-a896ac2206c8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.718223] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1195.218098] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.218541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.218541] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.219528] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a48f830-c1b3-4aed-99de-a896ac2206c8 with status ACTIVE [ 1195.219768] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.219998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.219998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.220231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.220335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.220548] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.220682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.220751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.220866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.220946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.221178] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.221322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.221322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.221461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.221531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.221694] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a48f830-c1b3-4aed-99de-a896ac2206c8 is going to be updated. [ 1195.252330] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.252330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.252330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.252330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.252330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.252330] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a48f830-c1b3-4aed-99de-a896ac2206c8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.488364] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1195.488364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.724088] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.226353] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.226750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.226750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.226925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.227066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.227179] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 is going to be created. [ 1196.251946] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.252134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.252179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.252372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.252531] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.262054] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: UNINITIALIZED for 2s [ 1196.642521] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: SUCCESS [ 1196.642751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.728223] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1196.728504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.728691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.728943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.729151] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.729273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.729373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.729549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.729661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.729774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.729876] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.232521] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.232856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.232856] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.232944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.233132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.233233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.233415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.233605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.233694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.233783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.233936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.234040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.234091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.234231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.234364] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.234455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.234517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.234648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.234725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.234803] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.234889] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.737095] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1197.755349] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.755625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.755713] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.755847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.755933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.756164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.756275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.756318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.756474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.756594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.756783] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.756873] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.756951] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.757092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.757166] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.757352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.757444] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.757521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.757639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.757714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.757798] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1197.833789] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.834343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.834343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.834525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.834581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.858942] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1198.272508] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: SUCCESS [ 1198.272881] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.273343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.273589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.273807] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.273984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.274088] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.274266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.274384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.274489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.274590] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.780019] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.282642] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0: rpc.has_security_group_logging(os_id): False [ 1199.301301] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.301499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.301499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.301706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.301794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.302036] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.302136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.302199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.302395] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.302504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.302600] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 is going to be created. [ 1199.367831] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.368057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.368057] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.368210] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.368386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.378041] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: IN_PROGRESS for 2s [ 1199.712113] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1199.712113] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1199.877383] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1199.877674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.392745] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: SUCCESS [ 1201.393144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.713636] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1204.714016] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1205.620799] env[65443]: INFO networking_nsxv3.common.synchronization [req-388f4429-8ce3-486e-b29b-916780f7cd99 req-d7590a62-7050-40ab-80a2-40a79a78a8ee tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1205.621409] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGHEST for action security_group_members [ 1205.621760] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.621967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.622076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.622298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.622460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.622563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.622630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.622849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.622966] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.623083] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.125823] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.126232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.126232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.126232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.126342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.127473] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.127473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.127473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.127473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.127473] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.127473] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 is going to be updated. [ 1206.130225] env[65443]: INFO networking_nsxv3.common.synchronization [req-0ae89690-974d-4645-ba0e-e207b85c93ee req-7ab09157-dd50-422f-a82f-548c4f96b7bf tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1206.131274] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1206.131627] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.131783] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.131896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.132101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.132288] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.132423] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.132518] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.132704] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.132835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.132959] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.159387] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.159573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.159622] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.159796] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.159928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.167934] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: IN_PROGRESS for 2s [ 1206.635769] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.635983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.636084] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.636384] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.636613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.637125] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.637125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.637125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.637263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.637471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.637471] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1206.669241] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.669241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.669241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.669502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.669502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.678367] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1208.177370] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 in Status: SUCCESS [ 1208.177775] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 deletion is rescheduled due to dependency. [ 1208.177775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.688237] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1208.688413] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1208.688529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.751624] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-411 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.751803] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.751931] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.752223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.752469] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.752623] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.752738] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.752952] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.753112] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.753318] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.753537] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.753672] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.753783] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.753895] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.754009] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.754200] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.774095] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.774095] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.774095] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.774309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-411" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.774632] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.774937] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.775123] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.775486] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.775578] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd567ccb-1664-4fa9-b38e-3c0e24fb9765',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.277751] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.278185] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.278185] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.278307] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.278454] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.278734] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.278891] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.279015] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.279233] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.279369] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.279641] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.279967] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.280119] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.280329] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.280464] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.280603] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 is going to be updated. [ 1209.302200] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.302453] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.302561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.302841] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.303218] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.303455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.010764] env[65443]: INFO networking_nsxv3.common.synchronization [req-4133fc58-6256-4265-b505-fcca42f5410a req-af6373c2-dee5-4eb9-913a-eaf285fad67e service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1210.010959] env[65443]: INFO networking_nsxv3.common.synchronization [req-4133fc58-6256-4265-b505-fcca42f5410a req-af6373c2-dee5-4eb9-913a-eaf285fad67e service nova] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1210.011145] env[65443]: INFO networking_nsxv3.common.synchronization [req-4133fc58-6256-4265-b505-fcca42f5410a req-af6373c2-dee5-4eb9-913a-eaf285fad67e service nova] Enqueued Resource ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with Priority: HIGHEST for action port [ 1210.011729] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_rules [ 1210.011880] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1210.011995] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with Priority: HIGHEST for action port [ 1210.012893] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.013076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.013156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.013427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.013547] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.014857] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.015280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.015280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.015443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.016397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.016397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.016397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.016397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.016397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.016397] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.017743] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.017804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.017911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.018436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.018436] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd567ccb-1664-4fa9-b38e-3c0e24fb9765',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.515103] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-450 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.515489] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.515489] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.515810] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.516085] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.516248] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.516363] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.516666] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.516827] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.517053] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.517169] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.517526] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.517526] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.517526] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.517672] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.517703] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.519022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.519122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.519630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd567ccb-1664-4fa9-b38e-3c0e24fb9765 with status ACTIVE [ 1210.519795] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.519897] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.519983] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.520125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.520206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.520370] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.520463] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.520525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.520661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.520758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.520937] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.521038] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.521100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.521234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.521304] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.521386] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd567ccb-1664-4fa9-b38e-3c0e24fb9765 is going to be updated. [ 1210.522699] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.542169] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.542343] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.542468] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.542645] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-450" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.542960] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-a9f8068d-1de8-4e4e-9a29-61b474adf683 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.543143] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.543272] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.543622] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.543772] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f8068d-1de8-4e4e-9a29-61b474adf683',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.546914] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.546914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.546914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.547136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.547200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.547353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd567ccb-1664-4fa9-b38e-3c0e24fb9765" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.025883] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.046371] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.046593] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.046736] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.047013] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.047177] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.047459] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.047611] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.047728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.048026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.048208] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.048465] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.048644] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.048751] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.048968] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.049130] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.049268] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 is going to be updated. [ 1211.070816] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.071091] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.071245] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.071558] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.071829] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.072134] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.527918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.528325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.528325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.528393] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.528485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.528619] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1211.558327] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.558327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.558594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.558721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.558898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.568990] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [req-6abfb130-01c1-4e4d-9e0c-3717871a5565 req-e98964dd-b82b-4e58-b641-cef77a84bd20 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [req-6abfb130-01c1-4e4d-9e0c-3717871a5565 req-e98964dd-b82b-4e58-b641-cef77a84bd20 service nova] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [req-6abfb130-01c1-4e4d-9e0c-3717871a5565 req-e98964dd-b82b-4e58-b641-cef77a84bd20 service nova] Enqueued Resource ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 with Priority: HIGHEST for action port [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_rules [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1211.770130] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 with Priority: HIGHEST for action port [ 1211.770721] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.770721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.770721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.770721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.770721] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.772193] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.772193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.772193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.772193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.772426] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.773013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.773013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.773013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.773013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.773013] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.774200] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9f8068d-1de8-4e4e-9a29-61b474adf683 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.774200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.774200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.774716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.774716] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9f8068d-1de8-4e4e-9a29-61b474adf683',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.273130] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.273349] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.275610] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.276629] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a9f8068d-1de8-4e4e-9a29-61b474adf683 with status ACTIVE [ 1212.276810] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.276922] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.277018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.277200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.277290] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.277459] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.277576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.277654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.277809] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.277888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.278084] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.278179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.278240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.278375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.278446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.278530] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a9f8068d-1de8-4e4e-9a29-61b474adf683 is going to be updated. [ 1212.312334] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.312582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.312582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.312725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.312815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.312979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9f8068d-1de8-4e4e-9a29-61b474adf683" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.780525] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.283069] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.283069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.283069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.283308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.283377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.283509] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1213.315851] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.316045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.316113] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.316336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.316510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.328470] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1213.581310] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1213.581504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.581642] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.581896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.582107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.582228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.582295] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.582451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.582542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.582647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.582744] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.085031] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.085343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.085343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.085412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.085617] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.085744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.085811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.085941] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.086037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.086128] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.086276] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.086369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.086427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.086566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.086701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.086791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.086849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.086980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.087064] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.087143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.087232] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.589588] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e276458-6ae4-4b43-8889-3fac24210880: rpc.has_security_group_logging(os_id): False [ 1214.611041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.611327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.611424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.611640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.611734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.611954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.612278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.612353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.612528] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.612621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.612682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.612815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.612886] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.613072] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.613161] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.613220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.613353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.613412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.613910] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1214.776925] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.777152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.777152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.777380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.777489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.797621] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1215.339479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1215.339944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.340187] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.340439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.340649] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.340774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.340863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.341018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.341093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.341182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.341305] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.844066] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.844066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.844066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.844283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.844448] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.844554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.844617] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.844764] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.844849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.844937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.845097] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.845246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.845278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.845389] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.845520] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.845697] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.845759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.845894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.845980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.846071] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.846162] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.348525] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abf65220-606f-4a01-8e7d-91599d70c077: rpc.has_security_group_logging(os_id): False [ 1216.368209] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.368385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.368432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.369314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.369433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.369681] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.369797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.369992] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.370035] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.370124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.370311] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.370426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.370455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.370603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.370679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.370860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.370948] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.371017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.371670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.371793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.371913] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1216.439187] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.439464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.439464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.439798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.440045] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.455273] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1216.771031] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1216.771031] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1216.816324] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1216.816615] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.472573] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1218.472975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.556595] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc843eb-c50a-4555-8aa8-6a1ce9b1d184 req-5292a220-ee0c-4bf2-99b8-64e2571d41b5 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1219.557119] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1219.557561] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.557702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.557789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.557988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.558165] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.558270] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.558323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.558487] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.558584] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.558675] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.949493] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.950820] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.950820] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.951243] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.951243] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.951352] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1219.951455] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1219.951558] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1219.951666] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1219.951770] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1219.951902] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1219.981282] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1219.981501] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1219.981614] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1219.981752] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.982133] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-1a1fa049-d8a2-4386-a1be-dac516ba3534 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.982336] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.982433] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.982792] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.982927] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1fa049-d8a2-4386-a1be-dac516ba3534',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.061677] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.061883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.061973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.062182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.062299] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.062507] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.062993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.062993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.062993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.062993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.062993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be deleted. [ 1220.102025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.102201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.102256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.102446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.102540] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.102639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.485780] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.485985] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.486129] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.486422] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.486582] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.486786] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 1a1fa049-d8a2-4386-a1be-dac516ba3534 not found, creating... [ 1220.487060] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.487206] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.487317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.487533] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.487675] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.487970] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.488124] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.488240] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.488446] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.488584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.488740] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 is going to be created. [ 1220.510717] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.511019] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.511290] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.511670] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.511998] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.512317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.089170] env[65443]: INFO networking_nsxv3.common.synchronization [req-fc032df8-f031-4475-8396-c173aee4c8ae req-0b53e396-c9ca-47f1-9bf4-b576e30fb277 tempest-AttachVolumeNegativeTest-177784193 tempest-AttachVolumeNegativeTest-177784193-project-member] Enqueued Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1221.089869] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 with Priority: HIGHEST for action security_group_members [ 1221.090967] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-79e0e43b-4683-4690-b35f-e325fdce8e11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.091124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.091192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.091426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.091601] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.091720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.091777] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.091896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.091985] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.092102] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79e0e43b-4683-4690-b35f-e325fdce8e11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.254887] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc843eb-c50a-4555-8aa8-6a1ce9b1d184 req-da27ab75-9f7b-49d8-9c6b-99ef5b287a4f service nova] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_rules [ 1221.255125] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc843eb-c50a-4555-8aa8-6a1ce9b1d184 req-da27ab75-9f7b-49d8-9c6b-99ef5b287a4f service nova] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1221.255266] env[65443]: INFO networking_nsxv3.common.synchronization [req-0cc843eb-c50a-4555-8aa8-6a1ce9b1d184 req-da27ab75-9f7b-49d8-9c6b-99ef5b287a4f service nova] Enqueued Resource ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 with Priority: HIGHEST for action port [ 1221.256488] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_rules [ 1221.256685] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1221.256812] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 with Priority: HIGHEST for action port [ 1221.257087] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.257219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.257289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.257501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.257584] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.262214] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.262214] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.262329] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.262450] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.262979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.263490] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.263577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.263748] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.263837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.263943] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.265802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1fa049-d8a2-4386-a1be-dac516ba3534 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.265802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.265977] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.266063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.266127] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1fa049-d8a2-4386-a1be-dac516ba3534',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.594979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.595196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.595266] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.595476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.595566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.595839] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.596022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.596022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.596170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.596248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.596374] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 is going to be updated. [ 1221.624431] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.624613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.624613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.624825] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.624961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.633461] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: IN_PROGRESS for 2s [ 1221.762600] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.762698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.766792] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.767804] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a1fa049-d8a2-4386-a1be-dac516ba3534 with status ACTIVE [ 1221.768027] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.768154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.768223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.768425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.768575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.768683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.768779] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.768841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.768981] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.769069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.769243] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.769334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.769396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.769530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.769604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.769686] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 is going to be updated. [ 1221.803254] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.803427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.803489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.803695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.803826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.803986] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.843052] env[65443]: INFO networking_nsxv3.common.synchronization [req-142c613e-a979-401f-a55a-385e11513644 req-60375e73-633e-4aec-8fa1-00771aebfb98 tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1221.843500] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1221.843876] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.843999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.846247] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.847603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.847864] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.848148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.848209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.848541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.848541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.848697] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.177019] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-574 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.177391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.177481] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.177806] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.178175] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.178391] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.178566] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.178866] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.179102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.179569] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.179569] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.179704] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.179839] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.179999] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.180145] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.180323] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.202609] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.202827] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1222.202968] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.203194] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-574" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.203520] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-ca073e56-8a3d-41ce-837c-0b42596ba6e0 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.203735] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.203840] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.204177] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.204317] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca073e56-8a3d-41ce-837c-0b42596ba6e0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.271645] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.351306] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.351456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.351528] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.351861] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.352041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.352346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.352559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.352559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.352707] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.352884] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.352979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1222.384728] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.384728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.384728] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.384961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.385184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.400260] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1222.706468] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.706876] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.710025] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port ca073e56-8a3d-41ce-837c-0b42596ba6e0 not found, creating... [ 1222.710025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.710025] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.710025] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.710518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.710518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.710518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.710518] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.710518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: ca073e56-8a3d-41ce-837c-0b42596ba6e0 is going to be created. [ 1222.734611] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.734887] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.735000] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.735356] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.735662] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.735897] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.775281] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.775539] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.775670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.775988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.776240] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.776439] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be created. [ 1222.804055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.804259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.804259] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.804445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.804604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.828762] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: UNINITIALIZED for 2s [ 1223.554187] env[65443]: INFO networking_nsxv3.common.synchronization [req-142c613e-a979-401f-a55a-385e11513644 req-d2ec34a8-6501-4fae-80df-6c53673447ea service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1223.554187] env[65443]: INFO networking_nsxv3.common.synchronization [req-142c613e-a979-401f-a55a-385e11513644 req-d2ec34a8-6501-4fae-80df-6c53673447ea service nova] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1223.554187] env[65443]: INFO networking_nsxv3.common.synchronization [req-142c613e-a979-401f-a55a-385e11513644 req-d2ec34a8-6501-4fae-80df-6c53673447ea service nova] Enqueued Resource ID: ca073e56-8a3d-41ce-837c-0b42596ba6e0 with Priority: HIGHEST for action port [ 1223.557354] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_rules [ 1223.557499] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1223.557596] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca073e56-8a3d-41ce-837c-0b42596ba6e0 with Priority: HIGHEST for action port [ 1223.558043] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.558147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.558190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.558401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.558483] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.559532] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.559668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.559887] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca073e56-8a3d-41ce-837c-0b42596ba6e0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.559998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.560815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.561066] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.561066] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca073e56-8a3d-41ce-837c-0b42596ba6e0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.649425] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 in Status: SUCCESS [ 1223.649425] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79e0e43b-4683-4690-b35f-e325fdce8e11 deletion is rescheduled due to dependency. [ 1223.649643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79e0e43b-4683-4690-b35f-e325fdce8e11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.063211] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.063412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.064713] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca073e56-8a3d-41ce-837c-0b42596ba6e0 with status ACTIVE [ 1224.064954] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.065070] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.065153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.065350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.065441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.065858] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.065858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.065858] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.066062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.066110] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.066278] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.066379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.066426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.066551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.066625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.067175] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca073e56-8a3d-41ce-837c-0b42596ba6e0 is going to be updated. [ 1224.092697] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.092931] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.093060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.093333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.093455] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.093694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca073e56-8a3d-41ce-837c-0b42596ba6e0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.413906] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1224.414124] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1224.414230] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.414771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.414771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.414932] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.415028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.415028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.415209] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.415261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.415360] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.841493] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 1224.841805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.842041] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.842342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.842610] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.842794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.842842] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.843019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.843104] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.843381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.843381] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.918595] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.346308] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.346308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.346469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.346641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.347262] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.347385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.347456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.347631] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.347723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.347814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.347985] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.348107] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.348172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.348316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.348456] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.348546] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.348609] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.348771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.348874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.348995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.349159] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.422052] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.851737] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9c23fcc-9053-4dec-a147-96680fce42a2: rpc.has_security_group_logging(os_id): False [ 1225.877895] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.877895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.877895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.877895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.877895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.878286] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.878286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.878286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.878424] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.878568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.878777] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.878907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.878967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.879101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.879169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.879374] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.879521] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.879590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.879736] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.879839] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.879897] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be created. [ 1225.923827] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.924229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.924229] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.924445] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.924604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.924818] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1225.961771] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.962033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.962154] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.962439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.962643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.964913] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.965078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.965182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.965440] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.965727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.980243] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1225.982542] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: IN_PROGRESS for 2s [ 1226.320667] env[65443]: INFO networking_nsxv3.common.synchronization [req-d8044632-e5b5-40c4-b614-cf44189d8071 req-0bc6d6b2-883e-467b-a205-3c9a514b1abd tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1226.321516] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1226.322787] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.322787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.322787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.322787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.322787] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.323169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.323227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.325465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.325465] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.325465] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.825498] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.327841] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.831949] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.832122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.832193] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.832408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.832497] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.832592] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be updated. [ 1227.863640] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.864047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.864149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.864376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.864542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.875037] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1227.991392] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1227.991392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.991547] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.991723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.991928] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.992062] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.992355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.992431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.992481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.992577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.992689] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.994484] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 1227.994593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.496979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.496979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.496979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.496979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.496979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.496979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.497703] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.497703] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.497961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.497961] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.498125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.498125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.498257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.498325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.498410] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.498500] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.002286] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa4bbe71-1aad-451f-8727-4ac6ab1cac34: rpc.has_security_group_logging(os_id): False [ 1229.021094] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.021372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.021372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.021549] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.021607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.021905] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.022067] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.022144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.022273] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.022344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.022544] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.022639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.022706] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.022836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.022914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.023126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.023228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.023284] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.023414] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.023509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.024174] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1229.100690] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.101206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.101206] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.101385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.101385] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.120110] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1229.886145] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1229.886554] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.987700] env[65443]: INFO networking_nsxv3.common.synchronization [req-75e49e3f-aef2-418e-8bcd-1a43d7746900 req-01a1fe0d-5ccb-4944-b5ec-98dea33d60e0 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1230.987700] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGHEST for action security_group_members [ 1230.988522] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.988522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.988616] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.988837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.989096] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.989286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.989286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.989443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.989563] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.989714] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.053143] env[65443]: INFO networking_nsxv3.common.synchronization [req-75e49e3f-aef2-418e-8bcd-1a43d7746900 req-01a1fe0d-5ccb-4944-b5ec-98dea33d60e0 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 with Priority: HIGHEST for action port [ 1231.053826] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 with Priority: HIGHEST for action port [ 1231.054731] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a1fa049-d8a2-4386-a1be-dac516ba3534 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.054893] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.055080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.055269] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.055354] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a1fa049-d8a2-4386-a1be-dac516ba3534',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.140873] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1231.141125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.493243] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.493427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.493482] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.494132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.494132] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.494132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.494339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.494339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.494551] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.494652] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.494789] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be updated. [ 1231.530838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.531098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.531098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.531267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.531412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.543733] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: IN_PROGRESS for 2s [ 1231.558775] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a1fa049-d8a2-4386-a1be-dac516ba3534 with status ACTIVE [ 1231.558932] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.559136] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.559231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.559560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.559771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.560052] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.560224] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.560327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.560565] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.561172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.561172] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.561172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.561594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.561594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.561594] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.561748] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a1fa049-d8a2-4386-a1be-dac516ba3534 is going to be updated. [ 1231.587346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.587591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.588200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.588200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.588200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.588552] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a1fa049-d8a2-4386-a1be-dac516ba3534" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.813764] env[65443]: INFO networking_nsxv3.common.synchronization [req-1d9627d7-4acc-4799-ba24-dbfdf3692fb4 req-4e703158-6dbb-4c86-b06c-abc7da9e7380 tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1232.814397] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGHEST for action security_group_members [ 1232.815787] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.815787] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.815787] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.815787] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.318351] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.318582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.318582] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.318819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.318911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.319132] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.319235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.319298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.319456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.319556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.319617] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be updated. [ 1233.351860] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.352079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.352079] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.352286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.352425] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.361539] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: IN_PROGRESS for 2s [ 1233.554269] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9c23fcc-9053-4dec-a147-96680fce42a2 in Status: SUCCESS [ 1233.554439] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 deletion is rescheduled due to dependency. [ 1233.554555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.379207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b9d2da46-c29b-499a-9e47-3cf63308571e in Status: SUCCESS [ 1235.379724] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e deletion is rescheduled due to dependency. [ 1235.379724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.680962] env[65443]: INFO networking_nsxv3.common.synchronization [None req-0d592e17-962d-4ee0-9380-aa130b3bb0cb tempest-AttachInterfacesTestJSON-832176289 tempest-AttachInterfacesTestJSON-832176289-project-member] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1237.680962] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGHEST for action security_group_members [ 1237.681404] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.681404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.681404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.681677] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.681717] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.681866] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.681908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.682075] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.682169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.682272] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.185432] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.185620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.185620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.185894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.185894] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.186123] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.186216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.186278] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.186436] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.186516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.186575] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be updated. [ 1238.270059] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.270303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.270303] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.270379] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.270729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.281180] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: IN_PROGRESS for 2s [ 1240.295103] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e276458-6ae4-4b43-8889-3fac24210880 in Status: SUCCESS [ 1240.295419] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 deletion is rescheduled due to dependency. [ 1240.295501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.682212] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.682212] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1243.369372] env[65443]: INFO networking_nsxv3.common.synchronization [None req-1ef05d23-551b-470d-af3f-6b6a387faaa6 None None] Enqueued Resource ID: 4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8 with Priority: HIGHEST for action port [ 1243.370067] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8 with Priority: HIGHEST for action port [ 1243.370547] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.370678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.371047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.371153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.371207] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.846233] env[65443]: INFO networking_nsxv3.common.synchronization [req-8ff71822-eeee-4d2e-9b97-39b2ea6b6345 req-72b9bb3a-29a0-489e-bb8e-2ce94f7f4406 tempest-ServersNegativeTestJSON-346294223 tempest-ServersNegativeTestJSON-346294223-project-member] Enqueued Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1243.846719] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abf65220-606f-4a01-8e7d-91599d70c077 with Priority: HIGHEST for action security_group_members [ 1243.847039] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-abf65220-606f-4a01-8e7d-91599d70c077 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.847167] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.847235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.847433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.847587] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.847682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.847745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.847885] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.847971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.849395] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abf65220-606f-4a01-8e7d-91599d70c077',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.873721] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8 [ 1243.873970] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.874123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.874169] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.874461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.874461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.874567] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8 already deleted. [ 1243.874608] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f4c8d0d-9036-479d-960b-3d6fa4b2f2f8" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.351469] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.351469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.351469] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.351926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.352024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.352236] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.352325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.352375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.352581] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.352716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.352885] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 is going to be updated. [ 1244.387461] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.387639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.387759] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.388024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.388233] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.405989] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: IN_PROGRESS for 2s [ 1245.314176] env[65443]: INFO networking_nsxv3.common.synchronization [None req-983d5c8b-c18b-4bb2-b9de-9a22387c1939 None None] Enqueued Resource ID: e80c763d-0062-468f-b64e-308511a2dab2 with Priority: HIGHEST for action port [ 1245.314888] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e80c763d-0062-468f-b64e-308511a2dab2 with Priority: HIGHEST for action port [ 1245.315219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-e80c763d-0062-468f-b64e-308511a2dab2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.315343] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e80c763d-0062-468f-b64e-308511a2dab2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.315413] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e80c763d-0062-468f-b64e-308511a2dab2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.315664] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e80c763d-0062-468f-b64e-308511a2dab2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.315775] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e80c763d-0062-468f-b64e-308511a2dab2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.819519] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e80c763d-0062-468f-b64e-308511a2dab2 [ 1245.819519] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.819519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.819519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.820256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.820256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.820256] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e80c763d-0062-468f-b64e-308511a2dab2 already deleted. [ 1245.820256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e80c763d-0062-468f-b64e-308511a2dab2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.420430] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abf65220-606f-4a01-8e7d-91599d70c077 in Status: SUCCESS [ 1246.420761] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abf65220-606f-4a01-8e7d-91599d70c077 deletion is rescheduled due to dependency. [ 1246.420880] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abf65220-606f-4a01-8e7d-91599d70c077" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.610702] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1247.610986] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:3 started [ 1248.364608] env[65443]: INFO networking_nsxv3.common.synchronization [req-f474332c-9b92-4c1f-849d-7dce5b890ed1 req-f2abe576-7a63-47e7-bbf5-3d6e51ebda0f tempest-ServerActionsV293TestJSON-1632459528 tempest-ServerActionsV293TestJSON-1632459528-project-member] Enqueued Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1248.365184] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c with Priority: HIGHEST for action security_group_members [ 1248.365498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.365621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.365691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.365926] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.366085] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.366194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.366283] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.366439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.366523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.366615] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf8af7a1-ee42-4cc7-9906-f51878ad2a6c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.869068] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.869441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.869441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.869441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.869577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.869762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.869867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.870592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.870592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.870592] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.870592] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c is going to be updated. [ 1248.903679] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.903835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.904141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.904141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.904262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.914547] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: IN_PROGRESS for 2s [ 1250.926666] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c in Status: SUCCESS [ 1250.927219] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf8af7a1-ee42-4cc7-9906-f51878ad2a6c deletion is rescheduled due to dependency. [ 1250.927219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf8af7a1-ee42-4cc7-9906-f51878ad2a6c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.106497] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-535 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.106715] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.106882] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.107608] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.107608] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.107759] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.107867] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.108097] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.108241] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.108449] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.108556] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.108662] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.108847] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.108962] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.109079] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.109207] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.128633] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.128795] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.128890] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.129081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-535" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.129395] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-aa4ac103-6c66-4516-940a-a0cf2f3d2410 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.129561] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.129680] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.129939] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.130089] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4ac103-6c66-4516-940a-a0cf2f3d2410',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.632662] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.632865] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.632962] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.633287] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.633438] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.633849] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.634032] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.634184] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.634405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.634545] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.634863] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.635033] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.635151] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.635366] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.635499] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.635642] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 is going to be updated. [ 1251.659186] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.659402] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.659509] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.659776] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.659998] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.660249] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.393176] env[65443]: INFO networking_nsxv3.common.synchronization [req-df20c48b-232b-43d5-ba29-e3b6c1c16f75 req-eddc2b6f-f42b-48c2-b5da-87fcf9d8574f service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1252.393853] env[65443]: INFO networking_nsxv3.common.synchronization [req-df20c48b-232b-43d5-ba29-e3b6c1c16f75 req-eddc2b6f-f42b-48c2-b5da-87fcf9d8574f service nova] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1252.393853] env[65443]: INFO networking_nsxv3.common.synchronization [req-df20c48b-232b-43d5-ba29-e3b6c1c16f75 req-eddc2b6f-f42b-48c2-b5da-87fcf9d8574f service nova] Enqueued Resource ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 with Priority: HIGHEST for action port [ 1252.397844] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_rules [ 1252.398061] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1252.398186] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 with Priority: HIGHEST for action port [ 1252.399468] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.399468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.399468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.399468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.399468] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.400213] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.400332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.400407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.400558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.400702] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.400798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.400859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.400993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.402453] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.402453] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.403373] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-aa4ac103-6c66-4516-940a-a0cf2f3d2410 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.403702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.403702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.403702] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.403808] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aa4ac103-6c66-4516-940a-a0cf2f3d2410',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.903759] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.905118] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aa4ac103-6c66-4516-940a-a0cf2f3d2410 with status ACTIVE [ 1252.905322] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.905535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.905535] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.905918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.905918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.906191] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.906191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.906191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.906459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.906459] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.906585] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.906669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.906721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.906891] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.907101] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.907101] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aa4ac103-6c66-4516-940a-a0cf2f3d2410 is going to be updated. [ 1252.908168] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.908355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.928766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.929537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.929742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.930017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.930223] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.930550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aa4ac103-6c66-4516-940a-a0cf2f3d2410" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.409429] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.912788] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.912962] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.913085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.913634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.913634] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.913634] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1253.951337] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.951571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.951618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.952524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.952524] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.962327] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1255.668517] env[65443]: INFO networking_nsxv3.common.synchronization [req-537cd78c-676a-4e75-86c4-8627be59b031 req-ad19be89-765f-4096-aacb-4cc9aa6df737 tempest-ServerAddressesNegativeTestJSON-81552472 tempest-ServerAddressesNegativeTestJSON-81552472-project-member] Enqueued Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1255.669095] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1255.669408] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.669532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.669600] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.669903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.670014] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.670120] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.670183] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.670332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.670415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.670591] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.959527] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-984 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.959718] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-984" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.959846] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-984" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.960294] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-984" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.960527] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.960793] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.960972] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.961286] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.961489] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.961713] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.961828] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1255.961934] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1255.962107] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1255.962266] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1255.962401] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1255.962533] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1255.974297] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1255.974505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.974661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.974949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.975158] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.975271] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.975336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.975488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.975568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.975654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.975741] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.983463] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1255.983624] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1255.983756] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1255.983961] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-984" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.984299] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.984470] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.984587] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.984889] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.985045] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a000b09-53dc-4985-9ddb-6d5187fdd7d0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.172959] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.173203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.173265] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.173496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.173586] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.173791] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.173908] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.173974] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.174140] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.174217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.174301] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 already deleted. [ 1256.174380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.477845] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.488091] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.488351] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.488484] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.488759] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.488901] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.489083] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 not found, creating... [ 1256.489353] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.489508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.489637] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.490018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.490185] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.491041] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.491041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.491041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.491041] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.491320] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.491320] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 is going to be created. [ 1256.510995] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.511279] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.511346] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.511610] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.511831] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.512068] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.980633] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf29a740-117d-4608-9ae8-3ea4e2f6be2e: rpc.has_security_group_logging(os_id): False [ 1256.999531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.999753] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.999859] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.000094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.000190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.000435] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.000537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.000603] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.000749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.000826] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.000912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1257.063598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.063744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.063815] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.064060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.064213] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.077973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1257.241683] env[65443]: INFO networking_nsxv3.common.synchronization [req-537cd78c-676a-4e75-86c4-8627be59b031 req-231ceb42-77ef-4175-a227-728fd1d0fa68 service nova] Enqueued Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_rules [ 1257.241929] env[65443]: INFO networking_nsxv3.common.synchronization [req-537cd78c-676a-4e75-86c4-8627be59b031 req-231ceb42-77ef-4175-a227-728fd1d0fa68 service nova] Enqueued Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1257.242123] env[65443]: INFO networking_nsxv3.common.synchronization [req-537cd78c-676a-4e75-86c4-8627be59b031 req-231ceb42-77ef-4175-a227-728fd1d0fa68 service nova] Enqueued Resource ID: 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 with Priority: HIGHEST for action port [ 1257.242796] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_rules [ 1257.242952] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1257.243106] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 with Priority: HIGHEST for action port [ 1257.243472] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.243590] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.243651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.243987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.244113] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.245334] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.245334] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.245525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.245604] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.245900] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.245994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.246195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.246342] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.246439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.246602] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.248426] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.248426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.248426] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.248643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.248643] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a000b09-53dc-4985-9ddb-6d5187fdd7d0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.750237] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.750354] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.750646] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.753232] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 with status ACTIVE [ 1257.753485] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.753657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.753657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.754335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.754335] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.754480] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.754480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.754670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.754744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.754799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.755065] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.755207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.755280] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.755446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.755520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.755692] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a000b09-53dc-4985-9ddb-6d5187fdd7d0 is going to be updated. [ 1257.779798] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.780177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.780177] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.780381] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.780517] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.780693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a000b09-53dc-4985-9ddb-6d5187fdd7d0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.253557] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.758025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.758255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.758307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.758553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.758651] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.758751] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 is going to be created. [ 1258.783622] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.783875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.783875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.783988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.784076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.793475] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: UNINITIALIZED for 2s [ 1259.094350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1259.094671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.796739] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.796739] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.797258] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.797309] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.797582] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.797757] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.797872] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.798110] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.798283] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.798508] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.798620] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1259.798727] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1259.798835] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1259.798959] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1259.799076] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1259.799206] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1259.822150] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1259.822334] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1259.822451] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1259.822625] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-792" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.822955] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-46132112-93de-44ee-8f40-cd3bb6d16fd5 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.823149] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.823271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.823534] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.823669] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46132112-93de-44ee-8f40-cd3bb6d16fd5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.326763] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.327103] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.327289] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.327683] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.327888] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.328398] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.328629] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.328794] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.329115] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.329307] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.329715] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.329931] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.330112] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.330399] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.330584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.330782] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 is going to be updated. [ 1260.361563] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.361826] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.362235] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.363046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.363046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.363046] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.807431] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: SUCCESS [ 1260.807890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.807890] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.808039] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.808142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.808262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.808325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.808494] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.808555] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.808690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.808753] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [req-37ec63e3-2966-477a-bed6-ef9d0721a2c6 req-b3dd6502-3004-4007-ba71-5196d9f4f6b8 service nova] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [req-37ec63e3-2966-477a-bed6-ef9d0721a2c6 req-b3dd6502-3004-4007-ba71-5196d9f4f6b8 service nova] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [req-37ec63e3-2966-477a-bed6-ef9d0721a2c6 req-b3dd6502-3004-4007-ba71-5196d9f4f6b8 service nova] Enqueued Resource ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 with Priority: HIGHEST for action port [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_rules [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1261.069797] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 with Priority: HIGHEST for action port [ 1261.069797] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.069797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.069797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.069797] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.069797] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.070474] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.070579] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.070641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.070799] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.070955] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.071098] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.071163] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.071355] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.071443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.071529] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.072543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-46132112-93de-44ee-8f40-cd3bb6d16fd5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.072543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.072543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.072669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.072669] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46132112-93de-44ee-8f40-cd3bb6d16fd5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.311725] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.311949] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.312037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.312272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.312457] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.312558] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.312623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.312789] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.312879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.312967] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.313122] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.313217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.313296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.313434] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.313571] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.313660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.313717] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.313851] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.313928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.314040] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.314138] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.574813] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.574952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.575248] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.576196] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46132112-93de-44ee-8f40-cd3bb6d16fd5 with status ACTIVE [ 1261.576411] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.576580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.576647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.576867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.576947] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.577131] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.577227] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.577286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.577432] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.577509] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.577682] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.577772] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.577831] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.578199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.578199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.578199] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46132112-93de-44ee-8f40-cd3bb6d16fd5 is going to be updated. [ 1261.599100] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.599315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.599360] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.599648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.599788] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.599995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46132112-93de-44ee-8f40-cd3bb6d16fd5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.816518] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4d47a2cc-8225-4d04-b2f0-0862da47a2b7: rpc.has_security_group_logging(os_id): False [ 1261.835428] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.835598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.835598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.835750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.835806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.836060] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.836216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.836288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.836446] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.836522] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.836716] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.836804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.837049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.837049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.837150] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.837343] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.837448] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.837506] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.837625] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.837695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.837777] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 is going to be created. [ 1261.896344] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.896493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.896583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.896765] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.896958] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.907777] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: IN_PROGRESS for 2s [ 1262.080488] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.583221] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.583430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.583481] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.583725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.583867] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.583948] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be updated. [ 1262.622980] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.623212] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.623289] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.623606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.623778] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.638283] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: IN_PROGRESS for 2s [ 1263.936137] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: SUCCESS [ 1263.936639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.360538] env[65443]: INFO networking_nsxv3.common.synchronization [req-92599a7d-f1c3-4320-8128-608b4cda8759 req-dcf7f9cd-b42c-40b1-97c0-772e2a25c5f5 tempest-AttachVolumeTestJSON-842532477 tempest-AttachVolumeTestJSON-842532477-project-member] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1264.361412] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGHEST for action security_group_members [ 1264.361950] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.362196] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.362327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.362627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.362883] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.363076] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.363198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.363449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.363689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.363734] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.648289] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1264.648589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.648830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.649168] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.649453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.649632] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.649740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.649990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.650148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.650287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.650440] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.866420] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.866654] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.866708] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.866924] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.867087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.867283] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.867396] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.867449] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.867612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.867684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.867838] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 is going to be updated. [ 1264.893873] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.894052] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.894124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.894333] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.894488] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.905355] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: IN_PROGRESS for 2s [ 1265.152866] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.655108] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0281fe2-9e20-4e23-b277-8c95ec2ef544: rpc.has_security_group_logging(os_id): False [ 1265.675164] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.675344] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.675433] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.675694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.675798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.676225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.676359] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.676429] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.676694] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.676791] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.676949] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be updated. [ 1265.737955] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.738241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.738241] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.738368] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.738504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.752055] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: IN_PROGRESS for 2s [ 1266.289957] env[65443]: INFO networking_nsxv3.common.synchronization [req-d1c1d9f4-7f4e-4f3e-bb22-fcb63fe48e5e req-c21972fb-0556-4369-a32d-acce5cc3af30 tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1266.293268] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1266.293268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.293268] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.293268] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.293268] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.670667] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.670892] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.671035] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.671354] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.671848] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.672111] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.672299] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.672588] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.672793] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.673105] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.673278] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1266.673459] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1266.673607] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1266.673776] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1266.673966] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1266.674211] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1266.695298] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1266.695518] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1266.695662] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1266.695867] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-302" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.696281] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-f41227cc-e0f9-4cb1-9819-7105440f4759 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.696508] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.696676] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.698257] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.698516] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f41227cc-e0f9-4cb1-9819-7105440f4759',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.794032] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.917494] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e990d13f-064b-4b30-b919-33291fa4a9c6 in Status: SUCCESS [ 1266.917740] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 deletion is rescheduled due to dependency. [ 1266.917896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.204248] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.204496] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.204664] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.205037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.205195] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.205347] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port f41227cc-e0f9-4cb1-9819-7105440f4759 not found, creating... [ 1267.205765] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.206056] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.206267] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.206406] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.206539] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.206937] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.207123] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.207248] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.207460] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.207668] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.207845] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: f41227cc-e0f9-4cb1-9819-7105440f4759 is going to be created. [ 1267.229398] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.229603] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.229719] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.229980] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.230327] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.230584] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.296748] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.770479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1267.770479] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.799314] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.799530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.799530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.799698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.799805] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.800063] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1267.830914] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.831094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.831144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.831352] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.831492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.840697] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1267.958477] env[65443]: INFO networking_nsxv3.common.synchronization [req-d1c1d9f4-7f4e-4f3e-bb22-fcb63fe48e5e req-64e46595-06d5-4350-8286-966ee958bad8 service nova] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 1267.958763] env[65443]: INFO networking_nsxv3.common.synchronization [req-d1c1d9f4-7f4e-4f3e-bb22-fcb63fe48e5e req-64e46595-06d5-4350-8286-966ee958bad8 service nova] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1267.958974] env[65443]: INFO networking_nsxv3.common.synchronization [req-d1c1d9f4-7f4e-4f3e-bb22-fcb63fe48e5e req-64e46595-06d5-4350-8286-966ee958bad8 service nova] Enqueued Resource ID: f41227cc-e0f9-4cb1-9819-7105440f4759 with Priority: HIGHEST for action port [ 1267.960593] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_rules [ 1267.960735] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1267.960840] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f41227cc-e0f9-4cb1-9819-7105440f4759 with Priority: HIGHEST for action port [ 1267.961138] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.961298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.961373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.961571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.961652] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.962564] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.962657] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.962853] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-f41227cc-e0f9-4cb1-9819-7105440f4759 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.962952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.963028] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.963189] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.963262] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f41227cc-e0f9-4cb1-9819-7105440f4759',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.465934] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.466913] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.467471] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f41227cc-e0f9-4cb1-9819-7105440f4759 with status ACTIVE [ 1268.468166] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.469194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.469194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.469194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.469194] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.469194] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.469620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.469620] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.469724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.469828] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.470144] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.470296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.470392] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.470591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.470683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.470827] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f41227cc-e0f9-4cb1-9819-7105440f4759 is going to be updated. [ 1268.530533] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.530802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.530802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.531014] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.531170] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.531406] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f41227cc-e0f9-4cb1-9819-7105440f4759" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.853648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1269.854049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.854249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.854468] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.854661] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.854780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.854846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.855013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.855087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.855224] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.357228] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.860060] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.362999] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.363179] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.363226] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.363483] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.363588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.363713] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1271.408107] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.408339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.408339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.408573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.408721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.418650] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1271.554459] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.554674] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.554735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.554995] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.555150] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.807339] env[65443]: INFO networking_nsxv3.common.synchronization [req-3c6ecd79-53e0-4d22-a6da-68f7914fa9a3 req-37c0df75-6d1f-4c46-b8a1-4ee0b45be99c tempest-ServerActionsTestOtherB-885041878 tempest-ServerActionsTestOtherB-885041878-project-member] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1271.807877] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGHEST for action security_group_members [ 1271.808228] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.808369] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.808439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.808641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.808785] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.808875] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.808934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.809124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.809184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.809255] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.057513] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.208135] env[65443]: INFO networking_nsxv3.common.synchronization [req-578dc5cc-3b4b-49e3-9069-a674691b49f9 req-dbc2a4ba-4f34-42cf-8130-3d6944d8b82b tempest-DeleteServersTestJSON-554805530 tempest-DeleteServersTestJSON-554805530-project-member] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1272.208696] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGHEST for action security_group_members [ 1272.209022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.209142] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.209204] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.209407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.209558] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.209658] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.209720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.209865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.209984] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.210179] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.311448] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.311640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.311692] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.312588] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.312588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.312901] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be updated. [ 1272.347974] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.348231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.348231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.348462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.348610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.361921] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: IN_PROGRESS for 2s [ 1272.401030] env[65443]: INFO networking_nsxv3.common.synchronization [req-9eee4786-f1fa-49d9-a1a4-653947401d18 req-d02ec84f-a0b1-498e-805b-54d61bcf162e tempest-ServerAddressesNegativeTestJSON-81552472 tempest-ServerAddressesNegativeTestJSON-81552472-project-member] Enqueued Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1272.401728] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGHEST for action security_group_members [ 1272.406895] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.406895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.406895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.407220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.407646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.408854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.408937] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.409149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.409248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.409430] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.560017] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.712712] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.712916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.712972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.713181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.713312] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.713567] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.713683] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.713750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.713915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.714017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.714101] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be updated. [ 1272.753021] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.753211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.753253] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.754033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.754033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.768364] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: IN_PROGRESS for 2s [ 1272.914073] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.914298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.914298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.914477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.914573] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.914781] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.914883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.914971] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.915153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.915239] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.915345] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 is going to be updated. [ 1272.948498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.948742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.948742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.948903] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.948993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.960973] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: IN_PROGRESS for 2s [ 1273.063648] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1273.064080] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1273.436808] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1273.436991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.437727] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.437847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.438074] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.438202] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.438952] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.439218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.439316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.439415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.439517] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.942625] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.102509] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.103102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.103102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.103102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.117290] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1274.118282] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.119357] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1274.160453] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.160718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.160718] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.160898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.177438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.178404] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1274.178528] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1274.178629] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1274.227828] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.228124] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.228182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.228394] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.230288] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.230497] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1274.331816] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.332738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.332738] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.332907] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.333238] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.333575] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1274.370969] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e in Status: SUCCESS [ 1274.371215] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e deletion is rescheduled due to dependency. [ 1274.371293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.427862] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.428111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.428190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.428510] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.429122] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.429196] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1274.429344] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'aa4bbe71-1aad-451f-8727-4ac6ab1cac34', '3e276458-6ae4-4b43-8889-3fac24210880', 'e9c23fcc-9053-4dec-a147-96680fce42a2', '1bdd1a1b-593c-44b0-8326-46df0c2407ac', 'a0885da6-24c4-4fd4-a461-f3dd5063f0a5', 'b1d34e09-75e3-43fa-8d8c-5bb269633d94', '373eadf5-9140-4fc8-8636-38b8598454fa', 'bf29a740-117d-4608-9ae8-3ea4e2f6be2e', 'e990d13f-064b-4b30-b919-33291fa4a9c6', 'cd675cf4-d8bc-40d7-9451-8c166df6f58a', 'd0b13ed0-b04f-4117-97c4-0a86ea93c1b1', 'b9d2da46-c29b-499a-9e47-3cf63308571e', '4d47a2cc-8225-4d04-b2f0-0862da47a2b7', '384aae03-a82d-4592-a983-85af28dc063f', '57265bd0-8115-40d5-9d60-a57a4b18bbaf', '0497189d-9410-4586-bc37-f5d3774f6c57', 'e5bfca26-c658-4447-930a-98eaefa1aa11', '8a21b1b0-a493-4718-8c01-ec2d54222333', 'd41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f', 'f0281fe2-9e20-4e23-b277-8c95ec2ef544', 'ded103e4-c215-45f9-85d6-afc52b8ad0ec', '23540878-f6a1-4e06-86e4-4e60026efbeb', '4c155a28-d058-4976-8391-4c7cb25222de', '256b6662-e079-48f2-8a9b-ddfdeb035f28', '9a365df5-ead6-431d-bfd3-bcc282fcd060', '08bead38-748c-49c3-9386-219294620db2', 'b2d82110-b86b-41a0-912b-ef943cd62add', '3a44c9a5-6f34-40e8-bb18-8fd3522bbccf', '769b4f05-7719-4ada-ab75-56a9d188c7f0', '01bb9589-319b-4790-ae93-ec8c6f99bc54', 'a0e6e052-1eb7-4ae4-9fe7-21424b56a2f2', '81bf2cab-4b9a-41ce-82f6-260bedede9ec', '25b7cad8-5307-463b-8d72-d5e21db9d2b3', '510d8b5d-287f-4b17-a124-e17cca11cba8', '79e0e43b-4683-4690-b35f-e325fdce8e11', '4f5dbadc-9d06-44ee-adf5-0dfa362a28c0', 'ca7259b9-1e79-42d6-87f5-2acdaf792fd0', 'bf8af7a1-ee42-4cc7-9906-f51878ad2a6c', '9b8c4c8d-3b25-4427-a750-99a3dcc5e324', 'abf65220-606f-4a01-8e7d-91599d70c077', '32d4eeb4-d8a1-4a19-a639-e9bb163080a5', 'f7be5dea-7e21-4d7d-bb55-1264c2bd2864', 'a8408b2f-592c-45ed-bf39-d0ac93e874f2', '1004a68b-2190-4689-9601-8db71d48978e', '0ed02cbf-524b-4807-91ae-649fc532249a', '7c113e23-4653-415c-8339-d252037cc64b', 'eb18cd6e-092e-4f1e-972b-3476700e4c4d', '21f2dbdb-92d8-4566-bb7c-8c740d6edde6', '38621128-a58c-43d0-ab77-1ae5a5975b7b'} {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1274.429483] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1274.446300] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21f2dbdb-92d8-4566-bb7c-8c740d6edde6: rpc.has_security_group_logging(os_id): False [ 1274.451309] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.451474] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.451527] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.451726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.451814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.451962] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1274.452072] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1274.452072] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1274.469098] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.469242] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.469307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.469520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.493744] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.494079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.494235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.494316] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.494556] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.494628] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.494719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1274.564289] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.564462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.564536] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.564758] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.566096] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.566411] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1274.566490] env[65443]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65443) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1274.566563] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1274.566631] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1274.566709] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1274.566783] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGH for action security_group_rules [ 1274.566866] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGH for action security_group_rules [ 1274.566937] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGH for action security_group_rules [ 1274.567011] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGH for action security_group_rules [ 1274.567078] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGH for action security_group_rules [ 1274.567228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 1274.567228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGH for action security_group_rules [ 1274.567228] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 1274.567414] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGH for action security_group_rules [ 1274.567414] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGH for action security_group_rules [ 1274.567414] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGH for action security_group_rules [ 1274.567545] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGH for action security_group_rules [ 1274.567545] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGH for action security_group_rules [ 1274.567623] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGH for action security_group_rules [ 1274.567623] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGH for action security_group_rules [ 1274.567699] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGH for action security_group_rules [ 1274.567736] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGH for action security_group_rules [ 1274.567777] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGH for action security_group_rules [ 1274.567842] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGH for action security_group_rules [ 1274.567903] env[65443]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGH for action security_group_rules [ 1274.568017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.577103] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.577293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.577338] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.577530] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.577671] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.592582] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1274.777630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 in Status: SUCCESS [ 1274.777805] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 deletion is rescheduled due to dependency. [ 1274.777919] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.972924] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 in Status: SUCCESS [ 1274.973218] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 deletion is rescheduled due to dependency. [ 1274.973358] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.607203] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1276.607203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.402961] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1277.402961] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1277.402961] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c23fcc-9053-4dec-a147-96680fce42a2 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 373eadf5-9140-4fc8-8636-38b8598454fa with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5bfca26-c658-4447-930a-98eaefa1aa11 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 384aae03-a82d-4592-a983-85af28dc063f with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0497189d-9410-4586-bc37-f5d3774f6c57 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9d2da46-c29b-499a-9e47-3cf63308571e with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e990d13f-064b-4b30-b919-33291fa4a9c6 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 with Priority: HIGH for action security_group_rules [ 1277.404772] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e276458-6ae4-4b43-8889-3fac24210880 with Priority: HIGH for action security_group_rules [ 1277.405505] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac with Priority: HIGH for action security_group_rules [ 1277.405505] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.405505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.405505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.405505] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.405750] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa4bbe71-1aad-451f-8727-4ac6ab1cac34',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.406706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9c23fcc-9053-4dec-a147-96680fce42a2 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.406814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.406814] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.407198] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.407198] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9c23fcc-9053-4dec-a147-96680fce42a2',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.407874] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-373eadf5-9140-4fc8-8636-38b8598454fa taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.408069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.408069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.408181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.408250] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('373eadf5-9140-4fc8-8636-38b8598454fa',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.409312] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.410307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.410307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.410307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.410307] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('57265bd0-8115-40d5-9d60-a57a4b18bbaf',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.411688] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.411688] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.411688] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.411688] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.412460] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.412460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a21b1b0-a493-4718-8c01-ec2d54222333 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.412630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.412630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.412724] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.412771] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a21b1b0-a493-4718-8c01-ec2d54222333',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.413650] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5bfca26-c658-4447-930a-98eaefa1aa11 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.413774] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.413865] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.413999] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.414570] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5bfca26-c658-4447-930a-98eaefa1aa11',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.415317] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-384aae03-a82d-4592-a983-85af28dc063f taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.415420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.415523] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.415679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.415741] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('384aae03-a82d-4592-a983-85af28dc063f',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.416556] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0497189d-9410-4586-bc37-f5d3774f6c57 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.416679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.416798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.416904] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.416998] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0497189d-9410-4586-bc37-f5d3774f6c57',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.418053] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.418653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.418653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.418653] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.418653] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4d47a2cc-8225-4d04-b2f0-0862da47a2b7',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.419410] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b9d2da46-c29b-499a-9e47-3cf63308571e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.419532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.419589] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.419786] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.419864] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b9d2da46-c29b-499a-9e47-3cf63308571e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.420548] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.420656] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.420723] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.420889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.420962] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d0b13ed0-b04f-4117-97c4-0a86ea93c1b1',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.421675] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.421781] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.421847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.422025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.422101] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd675cf4-d8bc-40d7-9451-8c166df6f58a',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.422870] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e990d13f-064b-4b30-b919-33291fa4a9c6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.422975] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.423056] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.423200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.423285] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e990d13f-064b-4b30-b919-33291fa4a9c6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.423956] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.424102] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.424182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.424336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.424410] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1d34e09-75e3-43fa-8d8c-5bb269633d94',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.425081] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.425192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.425258] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.425420] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.425494] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf29a740-117d-4608-9ae8-3ea4e2f6be2e',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.426376] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.426511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.426575] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.426720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.426792] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a0885da6-24c4-4fd4-a461-f3dd5063f0a5',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.427500] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e276458-6ae4-4b43-8889-3fac24210880 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.427623] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.427739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.427989] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.428119] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e276458-6ae4-4b43-8889-3fac24210880',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.429706] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.430127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.430127] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.430262] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.430342] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bdd1a1b-593c-44b0-8326-46df0c2407ac',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.944055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.944055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.944055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.944055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.944055] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.944055] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.944577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.944577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.944577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.944577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.944577] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.992127] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.992363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.992363] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.992538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.996290] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.996489] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.013784] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.013980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.014888] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.015011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.015747] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.015853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.016567] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.016662] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.017739] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.017836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.018531] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.018624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.019317] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.019403] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.020126] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.020246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.025050] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.025218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.025905] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.027731] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.027870] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.028556] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.028989] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.029099] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.030137] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.030272] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.030386] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.031096] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.031508] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.031624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.032250] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.032627] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.032716] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.033402] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.033771] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.033863] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.034537] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.034961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.035064] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9c23fcc-9053-4dec-a147-96680fce42a2 is going to be deleted. [ 1278.036658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.036766] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.036811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.037063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.040907] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.041024] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.059174] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1278.059700] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.059979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 57265bd0-8115-40d5-9d60-a57a4b18bbaf is going to be deleted. [ 1278.060957] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.061205] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.080641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.080825] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e276458-6ae4-4b43-8889-3fac24210880 is going to be deleted. [ 1278.081681] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.081901] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.109678] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.109887] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a0885da6-24c4-4fd4-a461-f3dd5063f0a5 is going to be deleted. [ 1278.110740] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.110963] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.115841] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.116123] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.129075] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.129361] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.130520] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.130684] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.140293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.140468] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b9d2da46-c29b-499a-9e47-3cf63308571e is going to be deleted. [ 1278.141709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.141998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.171944] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.172146] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1d34e09-75e3-43fa-8d8c-5bb269633d94 is going to be deleted. [ 1278.173008] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.173256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.235246] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.235482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 373eadf5-9140-4fc8-8636-38b8598454fa is going to be deleted. [ 1278.236915] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.237325] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.290216] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.290480] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.309041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.309232] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.310485] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.310485] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.311162] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.311301] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f is going to be deleted. [ 1278.312192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.312408] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.347537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.347537] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0497189d-9410-4586-bc37-f5d3774f6c57 is going to be deleted. [ 1278.348156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.348387] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.464934] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.490765] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.490993] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.500312] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.500569] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.509195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.509415] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d0b13ed0-b04f-4117-97c4-0a86ea93c1b1 is going to be deleted. [ 1278.511328] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.511725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.557882] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.558134] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 384aae03-a82d-4592-a983-85af28dc063f is going to be deleted. [ 1278.559126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.559454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.564108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.564375] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.626726] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.627020] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.627978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.628136] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a21b1b0-a493-4718-8c01-ec2d54222333 is going to be deleted. [ 1278.629049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.629296] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.660661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.660940] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf29a740-117d-4608-9ae8-3ea4e2f6be2e is going to be deleted. [ 1278.662447] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.662771] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.733607] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.733796] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5bfca26-c658-4447-930a-98eaefa1aa11 is going to be deleted. [ 1278.734879] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.735190] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.737665] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.737835] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.742113] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.742348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.784332] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.784951] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e990d13f-064b-4b30-b919-33291fa4a9c6 is going to be deleted. [ 1278.786351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.786351] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.830644] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.830802] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.840902] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.841095] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4d47a2cc-8225-4d04-b2f0-0862da47a2b7 is going to be deleted. [ 1278.842308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.842308] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.889333] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.889501] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.903997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.904322] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bdd1a1b-593c-44b0-8326-46df0c2407ac is going to be deleted. [ 1278.905357] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.905630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.945936] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.945936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.957925] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.957925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa4bbe71-1aad-451f-8727-4ac6ab1cac34 is going to be deleted. [ 1278.958734] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.959141] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.960498] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.960624] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.967719] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0281fe2-9e20-4e23-b277-8c95ec2ef544: rpc.has_security_group_logging(os_id): False [ 1278.995568] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.995710] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd675cf4-d8bc-40d7-9451-8c166df6f58a is going to be deleted. [ 1278.997698] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.997920] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.998017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.998152] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9c23fcc-9053-4dec-a147-96680fce42a2" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.998326] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.998502] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.998576] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.998695] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-57265bd0-8115-40d5-9d60-a57a4b18bbaf" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.999305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.999491] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.999571] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.999721] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e276458-6ae4-4b43-8889-3fac24210880" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.999807] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.999934] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.000017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.000137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a0885da6-24c4-4fd4-a461-f3dd5063f0a5" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.000274] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.000397] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.000462] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b9d2da46-c29b-499a-9e47-3cf63308571e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.001086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.001086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001086] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1d34e09-75e3-43fa-8d8c-5bb269633d94" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.001443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.001553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001611] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d41a09eb-9ceb-4aa9-bf3c-6ce16f67e87f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.001691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.001829] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.001896] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.002017] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-373eadf5-9140-4fc8-8636-38b8598454fa" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.002149] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.002287] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.002353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.002470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0497189d-9410-4586-bc37-f5d3774f6c57" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.002645] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.002811] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.002887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.003018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d0b13ed0-b04f-4117-97c4-0a86ea93c1b1" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.003272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.003504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.003504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.003648] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a21b1b0-a493-4718-8c01-ec2d54222333" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.003710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.003849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.004074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.004074] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-384aae03-a82d-4592-a983-85af28dc063f" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.004249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.004292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.004339] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.004504] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf29a740-117d-4608-9ae8-3ea4e2f6be2e" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.004559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.004693] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.004768] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.004877] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5bfca26-c658-4447-930a-98eaefa1aa11" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.005011] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.005151] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.005267] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.005327] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e990d13f-064b-4b30-b919-33291fa4a9c6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.005451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.005580] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.005659] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.005761] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4d47a2cc-8225-4d04-b2f0-0862da47a2b7" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.033701] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.034034] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.034236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.034437] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.036513] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.036665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.072476] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.072802] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.072887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.072953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.073181] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.073261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.073350] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be updated. [ 1279.074441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.074619] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.074709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.074824] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bdd1a1b-593c-44b0-8326-46df0c2407ac" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.093493] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.093577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.093577] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.093794] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.093978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.094211] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa4bbe71-1aad-451f-8727-4ac6ab1cac34" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.163025] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.163254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.163254] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.163464] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.163553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.163670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd675cf4-d8bc-40d7-9451-8c166df6f58a" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.196492] env[65443]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1279.197321] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.197593] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.197660] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.197972] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.198156] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.227177] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: IN_PROGRESS for 2s [ 1281.242912] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1281.243218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.406333] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.406945] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.407962] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.408285] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.969960] env[65443]: INFO networking_nsxv3.common.synchronization [req-654adebb-3eb3-497e-a8e7-8c551c7d08ac req-07a21e0f-dcfb-49b7-b504-219b329a07b6 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1288.970572] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 with Priority: HIGHEST for action security_group_members [ 1288.970911] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.971114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.971114] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.971319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.971466] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.971560] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.971626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.972298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.972298] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.972298] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f5dbadc-9d06-44ee-adf5-0dfa362a28c0',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.477598] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.477598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.477598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.477598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.501979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.501979] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.501979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.501979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.501979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.501979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.501979] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 is going to be updated. [ 1289.534022] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.534022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.534022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.534022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.534022] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.544167] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: IN_PROGRESS for 2s [ 1291.556925] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 in Status: SUCCESS [ 1291.557373] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f5dbadc-9d06-44ee-adf5-0dfa362a28c0 deletion is rescheduled due to dependency. [ 1291.557373] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f5dbadc-9d06-44ee-adf5-0dfa362a28c0" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.972081] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.972407] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.972955] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.973375] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.973851] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.974272] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1307.648040] env[65443]: INFO networking_nsxv3.common.synchronization [None req-aa8abdcb-fd98-455e-85e8-6e0fa8441372 None None] Enqueued Resource ID: 4e2d956d-66e9-48e0-92d6-610129af2425 with Priority: HIGHEST for action port [ 1307.648040] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e2d956d-66e9-48e0-92d6-610129af2425 with Priority: HIGHEST for action port [ 1307.648641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e2d956d-66e9-48e0-92d6-610129af2425 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.648641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e2d956d-66e9-48e0-92d6-610129af2425" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.648641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e2d956d-66e9-48e0-92d6-610129af2425" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.648641] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e2d956d-66e9-48e0-92d6-610129af2425" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.648641] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e2d956d-66e9-48e0-92d6-610129af2425',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.150817] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e2d956d-66e9-48e0-92d6-610129af2425 [ 1308.151709] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.151709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.151709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.151709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.152630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.152630] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e2d956d-66e9-48e0-92d6-610129af2425 already deleted. [ 1308.152630] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e2d956d-66e9-48e0-92d6-610129af2425" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.010593] env[65443]: INFO networking_nsxv3.common.synchronization [None req-8ce55591-52d5-44fb-aa12-3d0f8f2e57ac None None] Enqueued Resource ID: 4ca33aad-d142-4a80-b8fe-f1bae17e4021 with Priority: HIGHEST for action port [ 1310.011014] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca33aad-d142-4a80-b8fe-f1bae17e4021 with Priority: HIGHEST for action port [ 1310.011387] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ca33aad-d142-4a80-b8fe-f1bae17e4021 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.011533] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ca33aad-d142-4a80-b8fe-f1bae17e4021" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.011610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ca33aad-d142-4a80-b8fe-f1bae17e4021" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.011883] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ca33aad-d142-4a80-b8fe-f1bae17e4021" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.011987] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ca33aad-d142-4a80-b8fe-f1bae17e4021',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.514442] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ca33aad-d142-4a80-b8fe-f1bae17e4021 [ 1310.514762] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.514895] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.514991] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.515306] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.515431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.515556] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ca33aad-d142-4a80-b8fe-f1bae17e4021 already deleted. [ 1310.515668] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ca33aad-d142-4a80-b8fe-f1bae17e4021" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.354373] env[65443]: INFO networking_nsxv3.common.synchronization [req-7783330b-bd39-4f47-a1e0-46eade19d6e6 req-cdb41e23-70cd-4b8b-9590-db5533d31976 tempest-ServerMetadataTestJSON-279281131 tempest-ServerMetadataTestJSON-279281131-project-member] Enqueued Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1313.354989] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1313.355266] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.355380] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.355471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.355916] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.355916] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.356133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.356133] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.356297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.356297] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.356437] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.699237] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-17 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.699479] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.699631] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.700073] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.700406] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.700590] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.700712] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.700934] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.701092] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.701366] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1313.701534] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1313.701652] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1313.701761] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1313.701877] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1313.701983] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1313.702132] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1313.722294] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1313.722498] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1313.722586] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1313.722774] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-17" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.723100] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-eaac687b-6281-4642-ac6d-f042c6e02e8c taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.723271] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.723392] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.723767] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.723926] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaac687b-6281-4642-ac6d-f042c6e02e8c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.858658] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.858852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.858946] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.859221] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.859317] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.859552] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.859679] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.859751] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.859917] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.860013] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.860106] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ae189d-44b0-4e9c-845e-16447d284d04 already deleted. [ 1313.860215] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.227037] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.227037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.227037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.227389] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.227389] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.227459] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port eaac687b-6281-4642-ac6d-f042c6e02e8c not found, creating... [ 1314.227669] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.227828] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.227944] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.228178] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.228317] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.228600] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.228756] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.228861] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.229081] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.229223] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.229353] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: eaac687b-6281-4642-ac6d-f042c6e02e8c is going to be created. [ 1314.250767] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.251026] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.251114] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.251417] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.251655] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.251873] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.931527] env[65443]: INFO networking_nsxv3.common.synchronization [req-7783330b-bd39-4f47-a1e0-46eade19d6e6 req-db0c899d-501d-435e-846d-af1645590c2c service nova] Enqueued Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_rules [ 1314.931527] env[65443]: INFO networking_nsxv3.common.synchronization [req-7783330b-bd39-4f47-a1e0-46eade19d6e6 req-db0c899d-501d-435e-846d-af1645590c2c service nova] Enqueued Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1314.931882] env[65443]: INFO networking_nsxv3.common.synchronization [req-7783330b-bd39-4f47-a1e0-46eade19d6e6 req-db0c899d-501d-435e-846d-af1645590c2c service nova] Enqueued Resource ID: eaac687b-6281-4642-ac6d-f042c6e02e8c with Priority: HIGHEST for action port [ 1314.932143] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_rules [ 1314.932290] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1314.932452] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eaac687b-6281-4642-ac6d-f042c6e02e8c with Priority: HIGHEST for action port [ 1314.932664] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.932800] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.932837] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.933093] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.933175] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.934108] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.934185] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.934350] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.934409] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.934574] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.934627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.934968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.934968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.934968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.935116] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.937550] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-eaac687b-6281-4642-ac6d-f042c6e02e8c taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.937550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.937550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.938293] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.938293] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eaac687b-6281-4642-ac6d-f042c6e02e8c',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.439385] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.440583] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.440583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.440993] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eaac687b-6281-4642-ac6d-f042c6e02e8c with status ACTIVE [ 1315.441232] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.441399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.441399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.441602] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.441742] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.441917] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.442130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.442130] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.442336] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.442441] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.442646] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.442735] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.442798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.443047] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.443157] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.443264] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eaac687b-6281-4642-ac6d-f042c6e02e8c is going to be updated. [ 1315.465698] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.465874] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.465953] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.466217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.466412] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.466711] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eaac687b-6281-4642-ac6d-f042c6e02e8c" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.941782] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.424076] env[65443]: INFO networking_nsxv3.common.synchronization [req-831f9c48-2e8c-4496-98ed-daf3699f3066 req-2a11d60a-c2c0-4f80-ace1-91f046ecc3be tempest-AttachVolumeShelveTestJSON-297690695 tempest-AttachVolumeShelveTestJSON-297690695-project-member] Enqueued Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1316.424521] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 with Priority: HIGHEST for action security_group_members [ 1316.424838] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0281fe2-9e20-4e23-b277-8c95ec2ef544 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.425063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.425063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.425245] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.425421] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.425566] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.425640] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.425841] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.426404] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.426404] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0281fe2-9e20-4e23-b277-8c95ec2ef544',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.445015] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.445272] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.445739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.446443] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.446550] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.446677] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ae189d-44b0-4e9c-845e-16447d284d04 is going to be created. [ 1316.475258] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.475507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.475507] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.475665] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.475806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.486079] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: UNINITIALIZED for 2s [ 1316.931173] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.931391] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.931439] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.931627] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.931725] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.931938] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.932049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.932100] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.932261] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.932340] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.932421] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 is going to be updated. [ 1316.960532] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.961031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.961031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.961031] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.961153] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.970563] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: IN_PROGRESS for 2s [ 1318.501987] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: SUCCESS [ 1318.502399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.502399] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.502591] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.502803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.502929] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.502998] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.503217] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.503307] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.503400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.503493] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.979736] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 in Status: SUCCESS [ 1318.979930] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0281fe2-9e20-4e23-b277-8c95ec2ef544 deletion is rescheduled due to dependency. [ 1318.980037] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0281fe2-9e20-4e23-b277-8c95ec2ef544" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.006852] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.006852] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.007080] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.007121] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.007290] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.007407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.007456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.007606] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.007691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.007776] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.007918] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.008025] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.008090] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.008228] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.008363] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.008456] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.008520] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.008638] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.008714] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.008793] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.008883] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.511403] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69ae189d-44b0-4e9c-845e-16447d284d04: rpc.has_security_group_logging(os_id): False [ 1319.531248] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.531422] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.531471] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.531689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.531782] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.531981] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.532094] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.532159] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.532305] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.532383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.532554] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.532647] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.532709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.532945] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.533191] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.533397] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.533496] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.533559] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.533739] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.533818] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.533905] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69ae189d-44b0-4e9c-845e-16447d284d04 is going to be created. [ 1319.590766] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.591026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.591026] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.591144] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.591309] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.601602] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: IN_PROGRESS for 2s [ 1321.425687] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1321.426149] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1321.616656] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: SUCCESS [ 1321.616889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.788913] env[65443]: INFO networking_nsxv3.common.synchronization [req-664e5b00-e4b1-490f-8cc2-f5bf2b0061a8 req-c3cdc102-9b30-4fc4-81a8-523c6a7a0ea1 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1321.789369] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1321.789694] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.789819] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.789888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.790091] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.791415] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.791415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.791415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.791415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.791415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.791780] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.294748] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.294918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.294988] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.295203] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.318105] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.318344] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.318461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.318529] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.318750] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.318845] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.319210] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1322.351339] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.351499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.351499] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.351709] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.351918] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.361077] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1324.372739] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1324.373147] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 deletion is rescheduled due to dependency. [ 1324.373147] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.043456] env[65443]: INFO networking_nsxv3.common.synchronization [req-b83f2833-5135-4acf-a5da-0ead433def0b req-a7436028-af66-4505-8d69-2cfb71e73f42 tempest-ServerMetadataTestJSON-279281131 tempest-ServerMetadataTestJSON-279281131-project-member] Enqueued Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1325.043456] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69ae189d-44b0-4e9c-845e-16447d284d04 with Priority: HIGHEST for action security_group_members [ 1325.044451] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-69ae189d-44b0-4e9c-845e-16447d284d04 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.044451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.044451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.044451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.044451] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.044451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.044451] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.044928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.044928] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.044928] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69ae189d-44b0-4e9c-845e-16447d284d04',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.548171] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.548564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.548564] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.548643] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.548746] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.548923] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.549021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.549087] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.549236] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.549314] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.549404] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ae189d-44b0-4e9c-845e-16447d284d04 is going to be updated. [ 1325.576630] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.576832] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.576936] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.577219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.577430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.585672] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: IN_PROGRESS for 2s [ 1327.597889] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69ae189d-44b0-4e9c-845e-16447d284d04 in Status: SUCCESS [ 1327.597889] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69ae189d-44b0-4e9c-845e-16447d284d04 deletion is rescheduled due to dependency. [ 1327.597889] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69ae189d-44b0-4e9c-845e-16447d284d04" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.706999] env[65443]: INFO networking_nsxv3.common.synchronization [req-13104b61-28e7-45ae-8395-6b2555ec3b5b req-3619a08a-5983-46ec-b806-a846fb42ad5e tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1328.707589] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1328.707879] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.707994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.708216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.708427] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.708641] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.708720] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.708775] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.708923] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.709018] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.709115] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.000102] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.000306] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.000428] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.000704] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.001102] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.001102] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.001251] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.001425] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.001564] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.001775] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.001947] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1329.002016] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1329.002105] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1329.002213] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1329.002317] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1329.002447] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1329.023122] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1329.023344] env[65443]: DEBUG dogpile.cache.region [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1329.023490] env[65443]: DEBUG dogpile.lock [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1329.023714] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.024056] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock port-a3ad1995-d311-4786-8c6d-fed1d64e9811 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.024279] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.024415] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.024728] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.024864] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ad1995-d311-4786-8c6d-fed1d64e9811',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.212092] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.212092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.212092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.212092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.212092] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.212516] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.212516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.212516] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.212661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.212661] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.212741] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1329.240460] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.240710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.240710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.240878] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.241036] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.251760] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1329.527334] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.527580] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.527661] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.527953] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.528122] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.528278] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Segment Port a3ad1995-d311-4786-8c6d-fed1d64e9811 not found, creating... [ 1329.528544] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.528724] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.528853] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.529091] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.529231] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.529509] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.529667] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.529785] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.530056] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.530211] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.530354] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Resource: SegmentPort with ID: a3ad1995-d311-4786-8c6d-fed1d64e9811 is going to be created. [ 1329.550328] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.550530] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.550656] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.550907] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.551157] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.551379] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9738f54c-b6ff-48f6-aee0-89ae77a0becf None None] Releasing lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.241952] env[65443]: INFO networking_nsxv3.common.synchronization [req-13104b61-28e7-45ae-8395-6b2555ec3b5b req-a1e6018c-2cfc-4d23-adcc-91b89a995804 service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1330.242276] env[65443]: INFO networking_nsxv3.common.synchronization [req-13104b61-28e7-45ae-8395-6b2555ec3b5b req-a1e6018c-2cfc-4d23-adcc-91b89a995804 service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1330.242276] env[65443]: INFO networking_nsxv3.common.synchronization [req-13104b61-28e7-45ae-8395-6b2555ec3b5b req-a1e6018c-2cfc-4d23-adcc-91b89a995804 service nova] Enqueued Resource ID: a3ad1995-d311-4786-8c6d-fed1d64e9811 with Priority: HIGHEST for action port [ 1330.242503] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1330.242631] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1330.242726] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3ad1995-d311-4786-8c6d-fed1d64e9811 with Priority: HIGHEST for action port [ 1330.243342] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.243467] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.243538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.243731] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.243815] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.245088] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.245218] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.245973] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3ad1995-d311-4786-8c6d-fed1d64e9811 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.245973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.245973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.245973] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.245973] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3ad1995-d311-4786-8c6d-fed1d64e9811',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.748142] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.748407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.748489] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a3ad1995-d311-4786-8c6d-fed1d64e9811 with status ACTIVE [ 1330.748686] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.748780] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.748847] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.749085] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.749200] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.749352] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.749478] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.749763] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.749843] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.749933] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.750149] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.750257] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.750541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.750541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.750541] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.750740] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a3ad1995-d311-4786-8c6d-fed1d64e9811 is going to be updated. [ 1330.775203] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.775382] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.775454] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.775670] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.775806] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.775960] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3ad1995-d311-4786-8c6d-fed1d64e9811" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.264023] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1331.264023] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 deletion is rescheduled due to dependency. [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.264023] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.264023] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.264023] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.767106] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.270169] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.774145] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.774376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.774376] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.774596] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.774691] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.774790] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1332.804912] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.805143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.805143] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.805323] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.805470] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.814397] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1334.825464] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1334.825836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.825836] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.826060] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.826264] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.826400] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.826458] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.826626] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.826710] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.826798] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.826889] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.243489] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.243675] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1335.328955] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.831753] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a365df5-ead6-431d-bfd3-bcc282fcd060: rpc.has_security_group_logging(os_id): False [ 1335.850087] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.850255] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.850311] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.850511] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.850610] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.850850] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.850943] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.851021] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.851172] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.851249] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.851337] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1335.866636] env[65443]: INFO networking_nsxv3.common.synchronization [req-13dedf06-5c5c-415a-a67c-5744fde6048c req-75cc68d5-08bb-4daa-8ad8-3dfa18e8c84c tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1335.866636] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1335.866636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.866636] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.866636] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.866636] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.906865] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.907125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.907125] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.907300] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.907477] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.918975] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1336.368532] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1336.870475] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.372815] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.372990] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.373078] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.373292] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.373383] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.373479] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1337.400319] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.400493] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.400542] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.400712] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.400854] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.411021] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1337.932784] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1337.933248] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.421584] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1339.421994] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.866108] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.866108] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.866926] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.866926] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.868421] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.868800] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1352.268016] env[65443]: INFO networking_nsxv3.common.synchronization [req-ef213923-b7ba-4b0f-84fd-8dbbbfd2e368 req-cd38fda5-7e00-45d7-8588-ede2d52ed07f tempest-ServerActionsTestOtherA-1795417839 tempest-ServerActionsTestOtherA-1795417839-project-member] Enqueued Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1352.268016] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 with Priority: HIGHEST for action security_group_members [ 1352.268016] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.268016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.268016] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.268377] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.268377] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.268557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.268557] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.268682] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.268756] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.268862] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21f2dbdb-92d8-4566-bb7c-8c740d6edde6',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.773225] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.773492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.773492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.773629] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.773689] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.773878] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.773979] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.774082] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.774182] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.774256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.774341] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 is going to be updated. [ 1352.803014] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.803216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.803216] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.803401] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.803538] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.811725] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: IN_PROGRESS for 2s [ 1354.822833] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 in Status: SUCCESS [ 1354.823235] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21f2dbdb-92d8-4566-bb7c-8c740d6edde6 deletion is rescheduled due to dependency. [ 1354.823235] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21f2dbdb-92d8-4566-bb7c-8c740d6edde6" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.268079] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.268513] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1362.269619] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.269619] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.270887] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.270887] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.272298] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.272707] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.273656] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.274047] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.274839] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.274839] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.275576] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.275576] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.276288] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.276730] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.277674] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.278335] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.279655] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.279655] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1406.264460] env[65443]: INFO networking_nsxv3.common.synchronization [req-2f4fbb8a-da5f-4141-bba3-7da729936541 req-15006afb-8ff2-48ff-b581-c6735ba7b61d tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1406.265136] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1406.265476] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.265605] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.265690] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.265864] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.266041] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.266126] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.266199] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.266319] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.266405] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.266497] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1406.769051] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.769263] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.769315] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.769525] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.769618] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.769804] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.769899] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.770095] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.770184] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.770220] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.770268] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1406.806660] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1406.806909] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1406.806961] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1406.807175] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1406.807320] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1406.815804] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1408.827154] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1408.827621] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 deletion is rescheduled due to dependency. [ 1408.827621] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1411.266545] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1411.267000] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.233846] env[65443]: INFO networking_nsxv3.common.synchronization [req-450786ea-56ff-4c05-8f10-a40b371b6705 req-1fb72cfe-9e25-4f61-a66d-36df47578b5a tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1413.233846] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1413.233846] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.233846] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.233846] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.233846] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.527296] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.527498] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.527624] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.527878] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.528179] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.528343] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.528455] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.528673] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.528814] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.529029] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.529146] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] NeedRegenerationException {{(pid=65443) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1413.529271] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] no value, waiting for create lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1413.529361] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] value creation lock acquired {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1413.529469] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] No value present for key: 'zone-id' {{(pid=65443) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1413.529573] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Calling creation function for not-yet-present value {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1413.529702] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1413.551305] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1413.551464] env[65443]: DEBUG dogpile.cache.region [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65443) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1413.551579] env[65443]: DEBUG dogpile.lock [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Released creation lock {{(pid=65443) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1413.551741] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "network-774" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.552054] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock port-8a19c560-a189-4fc3-b30d-1952fd1ffa25 taken with stack trace [, , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.552275] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.552403] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.552707] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.552848] env[65443]: DEBUG networking_nsxv3.api.rpc [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a19c560-a189-4fc3-b30d-1952fd1ffa25',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.735613] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.735830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.735830] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.736019] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.736137] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.736334] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.736430] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.736484] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.736749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.736749] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.736897] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1413.761530] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.761729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.761729] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.761888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.762046] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.777971] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1414.055557] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.055803] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.055876] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.056179] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.056330] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.056482] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Segment Port 8a19c560-a189-4fc3-b30d-1952fd1ffa25 not found, creating... [ 1414.056808] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.057018] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.057141] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.057364] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.057506] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.057786] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.057939] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.058064] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.058273] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.058405] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.058543] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Resource: SegmentPort with ID: 8a19c560-a189-4fc3-b30d-1952fd1ffa25 is going to be created. [ 1414.079798] env[65443]: DEBUG networking_nsxv3.common.locking [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.080037] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.080126] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.080384] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.080606] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.080821] env[65443]: DEBUG oslo_concurrency.lockutils [None req-9dae6790-a0bf-415e-8edc-34861853c06d None None] Releasing lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.771787] env[65443]: INFO networking_nsxv3.common.synchronization [req-450786ea-56ff-4c05-8f10-a40b371b6705 req-7df79c27-963f-4c6e-8c94-1325b8b4dfeb service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1414.772059] env[65443]: INFO networking_nsxv3.common.synchronization [req-450786ea-56ff-4c05-8f10-a40b371b6705 req-7df79c27-963f-4c6e-8c94-1325b8b4dfeb service nova] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1414.772179] env[65443]: INFO networking_nsxv3.common.synchronization [req-450786ea-56ff-4c05-8f10-a40b371b6705 req-7df79c27-963f-4c6e-8c94-1325b8b4dfeb service nova] Enqueued Resource ID: 8a19c560-a189-4fc3-b30d-1952fd1ffa25 with Priority: HIGHEST for action port [ 1414.772640] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_rules [ 1414.772786] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1414.772906] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a19c560-a189-4fc3-b30d-1952fd1ffa25 with Priority: HIGHEST for action port [ 1414.773219] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.773348] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.773537] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.773612] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.773683] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.774497] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.774588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.774776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a19c560-a189-4fc3-b30d-1952fd1ffa25 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.774888] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.774968] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.775158] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.775232] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a19c560-a189-4fc3-b30d-1952fd1ffa25',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.276776] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.277069] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.277069] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a19c560-a189-4fc3-b30d-1952fd1ffa25 with status ACTIVE [ 1415.277251] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.277364] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.277431] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.277639] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.277726] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.277888] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.277987] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.278063] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.278219] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.278286] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.278461] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.278553] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.278613] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.278804] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.278849] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.278887] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a19c560-a189-4fc3-b30d-1952fd1ffa25 is going to be updated. [ 1415.310803] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.311073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.311073] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.311231] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.311372] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.311532] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a19c560-a189-4fc3-b30d-1952fd1ffa25" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.787997] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1415.787997] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 deletion is rescheduled due to dependency. [ 1415.787997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.787997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.787997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.788543] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.788543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.788543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.788543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.788543] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.788770] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.290857] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1416.793122] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.295864] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.296033] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.296111] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.296318] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.296407] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.296508] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1417.325683] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.325911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.325911] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.326097] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.326256] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.336818] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1419.353592] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1419.353997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.353997] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.354148] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.354346] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1419.354461] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1419.354519] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1419.354675] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1419.354757] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.354853] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1419.354948] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1419.774115] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.774281] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1419.856860] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.359296] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9a365df5-ead6-431d-bfd3-bcc282fcd060: rpc.has_security_group_logging(os_id): False [ 1420.377079] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.377260] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.377322] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.377498] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.377583] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.377817] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.377914] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.377978] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.378134] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.378207] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.378290] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1420.447638] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.447898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.447898] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.448049] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.448195] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.461106] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1422.477757] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1422.478201] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.775370] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.775742] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.776376] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.776796] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.777546] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.777933] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1439.778891] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1439.778891] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1444.780027] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1444.780430] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1449.781232] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1449.781608] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1454.782649] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1454.783101] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1459.783748] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1459.784144] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.785340] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1464.785811] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1469.785920] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.786410] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.787033] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1474.787417] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.473937] env[65443]: INFO networking_nsxv3.common.synchronization [req-7bc2e06e-e25d-4ef2-a1ca-259f92fa8436 req-c8ecc911-16b3-44af-a179-73de13d7e179 tempest-ServerActionsTestJSON-531028945 tempest-ServerActionsTestJSON-531028945-project-member] Enqueued Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1476.474661] env[65443]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 with Priority: HIGHEST for action security_group_members [ 1476.475065] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock member-9a365df5-ead6-431d-bfd3-bcc282fcd060 taken with stack trace [, , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.475192] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.475275] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.475492] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.475660] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.476438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.476438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.476438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.476438] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.476438] env[65443]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9a365df5-ead6-431d-bfd3-bcc282fcd060',) {} {{(pid=65443) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1476.979455] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.979687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.979687] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.979887] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.979980] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.980242] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1476.980353] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1476.980417] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1476.980588] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1476.980669] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1476.980759] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 is going to be updated. [ 1477.015170] env[65443]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65443) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.015415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.015415] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.015598] env[65443]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.015745] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.024196] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: IN_PROGRESS for 2s [ 1479.035776] env[65443]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 in Status: SUCCESS [ 1479.036234] env[65443]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9a365df5-ead6-431d-bfd3-bcc282fcd060 deletion is rescheduled due to dependency. [ 1479.036234] env[65443]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9a365df5-ead6-431d-bfd3-bcc282fcd060" {{(pid=65443) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1481.475453] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.475750] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.477140] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.477590] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1487.611688] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1487.612184] env[65443]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2dcbf652-3bf3-4365-8bf9-7ac5a96d9e4e None None] NSXv3 Agent Agent loop - iteration:4 started [ 1491.478683] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1491.479044] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1496.480170] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1496.480492] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1501.481853] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1501.482201] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1506.483151] env[65443]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1506.483852] env[65443]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0